-- Logs begin at Wed 2022-11-02 06:44:09 UTC, end at Wed 2022-11-02 07:42:45 UTC. -- Nov 02 07:13:12.116790 dv-cinder-804035-51-smb systemd[1]: Starting Devstack devstack@keystone.service... Nov 02 07:13:12.124034 dv-cinder-804035-51-smb devstack@keystone.service[81547]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 07:13:12 2022] *** Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: nodename: dv-cinder-804035-51-smb Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: machine: x86_64 Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: clock source: unix Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: pcre jit disabled Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: detected number of CPU cores: 4 Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: current working directory: / Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: detected binary path: /usr/bin/uwsgi-core Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: your processes number limit is 47680 Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: your memory page size is 4096 bytes Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: detected max file descriptor number: 2048 Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: lock engine: pthread robust mutexes Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: thunder lock: enabled Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 02 07:13:12.129030 dv-cinder-804035-51-smb devstack@keystone.service[81547]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 07:13:12.166235 dv-cinder-804035-51-smb devstack@keystone.service[81547]: Python main interpreter initialized at 0x55a7f6d659c0 Nov 02 07:13:12.166235 dv-cinder-804035-51-smb devstack@keystone.service[81547]: python threads support enabled Nov 02 07:13:12.166235 dv-cinder-804035-51-smb devstack@keystone.service[81547]: your server socket listen backlog is limited to 100 connections Nov 02 07:13:12.166235 dv-cinder-804035-51-smb devstack@keystone.service[81547]: your mercy for graceful operations on workers is 90 seconds Nov 02 07:13:12.166561 dv-cinder-804035-51-smb devstack@keystone.service[81547]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 07:13:12.166631 dv-cinder-804035-51-smb devstack@keystone.service[81547]: *** Operational MODE: preforking *** Nov 02 07:13:12.166851 dv-cinder-804035-51-smb devstack@keystone.service[81547]: *** uWSGI is running in multiple interpreter mode *** Nov 02 07:13:12.166851 dv-cinder-804035-51-smb devstack@keystone.service[81547]: spawned uWSGI master process (pid: 81547) Nov 02 07:13:12.167053 dv-cinder-804035-51-smb systemd[1]: Started Devstack devstack@keystone.service. Nov 02 07:13:12.168938 dv-cinder-804035-51-smb devstack@keystone.service[81547]: spawned uWSGI worker 1 (pid: 81558, cores: 1) Nov 02 07:13:12.168938 dv-cinder-804035-51-smb devstack@keystone.service[81547]: spawned uWSGI worker 2 (pid: 81559, cores: 1) Nov 02 07:13:12.168938 dv-cinder-804035-51-smb devstack@keystone.service[81547]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 07:13:16.439333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:13:16.439333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: from cryptography.utils import int_from_bytes Nov 02 07:13:16.440138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:13:16.440138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: from cryptography.utils import int_from_bytes Nov 02 07:13:16.440582 dv-cinder-804035-51-smb devstack@keystone.service[81558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:13:16.440582 dv-cinder-804035-51-smb devstack@keystone.service[81558]: from cryptography.utils import int_from_bytes Nov 02 07:13:16.440719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:13:16.440719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: from cryptography.utils import int_from_bytes Nov 02 07:13:16.490326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:13:16.490586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:13:16.490780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] command line args: [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:13:16.491046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:13:16.491222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ================================================================================ {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:13:16.491449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:13:16.491529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] admin_token = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.491646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:13:16.491732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] config_dir = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.491836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] command line args: [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:13:16.491914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.492025 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] config_source = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.492110 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:13:16.492187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] debug = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.492258 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ================================================================================ {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:13:16.492381 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.493727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] admin_token = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.493727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] config_dir = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.493862 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.493921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.493978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] config_source = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] debug = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494284 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_config_append = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494561 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494624 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494681 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_dir = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_file = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.494978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_config_append = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_dir = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495320 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_file = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.495679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.496045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.496140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.496268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.496346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.496459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.496533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.496649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.496733 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.496815 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.496929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.497024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.497098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.497163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.497242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.497354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.497508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.497592 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.497800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.497990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.498121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.498233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] publish_errors = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.498350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.498463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.498574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.498696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.498813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.498982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.499103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.499215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] publish_errors = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.499333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.499451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.499568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] standard_threads = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.499696 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.499818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.499930 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.500047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.500163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.500280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.500280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] use_journal = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.500498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.500609 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] use_json = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.500725 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] standard_threads = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.500838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] use_stderr = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.500954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.501139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] use_syslog = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.501256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.501368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.501485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.501604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.501717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] use_journal = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.501843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.501956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] use_json = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.501956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] use_stderr = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.502171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.502283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] use_syslog = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.502393 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.502511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:13:16.502631 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.502743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.502854 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.502965 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.503074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.503193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.503309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.503427 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.503545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.503657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.503768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.503886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.504003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.504120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.504232 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.504348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.504460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.504578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.504691 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.504801 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.504911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.505046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.505171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.505294 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.505406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.505517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.505633 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.505752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.505864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.505982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.506094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.506205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.506321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.506434 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.506619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.506734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.506846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.506956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.507149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.507265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.507384 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.507497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.507608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.507719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.507831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.507947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.508067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.508180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.508296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.508408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.508524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.508636 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.508753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.508875 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.508986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.509123 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.509242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.509354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.509473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.509586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.509696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.509807 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.509918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.510035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.510155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.510271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.510383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.510493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.510604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.510713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.510832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.510946 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.511056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.511173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.511291 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.511403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.511521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.511633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.511744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.511854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.511970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.512083 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.512275 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.512395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.512507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.512624 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.512735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.512846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.512964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.513129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.513241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.513352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.513462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.513572 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.513698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.513811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.513927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.514039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.514150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.514267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.514387 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.514500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.514610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.514610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.514815 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.514933 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.515029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.515129 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.515228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.515362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.515466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.515568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.515663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.515763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.515857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.515956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.516026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.516026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.516250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.516250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.516459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.516572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.516683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.516801 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.516920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.517061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.517178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.517290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.517414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.517527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.517650 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.517761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.517873 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.517873 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.518081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.518183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.518293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.518293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.518511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.518613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.518723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.518839 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.518951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.519075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.519189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.519306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.519419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.519531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.519642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.519763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.519876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.519987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.520101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.520212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.520326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.520446 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.520559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.521313 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.521498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.521660 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.521778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.521899 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.522014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.522126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.522239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.522357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.522471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.522592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.522707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.522707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.522916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.523028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.523140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.523140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.523325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.523419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.523532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.523650 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.523764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.523952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.524074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.524188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.524300 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.524412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.524532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.524655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.524776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.524890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.525003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.525135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.525247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.525359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.525483 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.525598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.525712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.525825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.525969 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.526096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.526218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.526333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.526446 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.526557 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.526670 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.526788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.526909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.527046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.external = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.527166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.527280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.527392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.527534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.527660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.527777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.527898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.528013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.password = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.528126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.528239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] auth.token = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.528352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.external = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.528465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.528585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.528700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.528814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.528928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.529067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.529183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.529312 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.password = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.529428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.529542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] auth.token = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.529655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.529774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.529922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.530050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.530165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.530282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.530396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.530510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.530628 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.530752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.530869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.530983 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.531096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.531208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.531321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.531442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.531557 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.531671 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.531783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.531897 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.532011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.532132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.532247 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.532390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.532503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.532616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.532729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.532850 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.532966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.533093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.533218 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.533366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.533487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.533608 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.533722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.533835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.533946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.534065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.534179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.534298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.534412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.534524 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.534636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.534754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.534875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.534989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.535102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.535214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.535326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.535438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.535557 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.535670 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.535782 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.535894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.536010 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.536123 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.536243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.536902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.537075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.537194 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.537307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.537419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.537544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.537659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.537771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.537884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.538003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.538116 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.538304 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.538419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.538532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.538532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.538742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.538855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.538980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.539094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.539208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.539321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.539433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.539545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.539545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.539764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.539877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.539989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.540102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.540214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.540342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.540457 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.540570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.540690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.540805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.540917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.541060 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.541177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.541177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.541389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.541502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.541614 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.541735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.541848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.541848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.542058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.542170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.542283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.542403 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.542517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.542630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.542743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.542856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.542969 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.543092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.543206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.543318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.543431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.543544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.543664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.543777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.543889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.544007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.544121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.544238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.544359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.544473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.544586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.544699 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.544811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.544929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.545101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.545218 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.545331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.545449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.545564 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.545677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.545798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.545911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.546024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.546136 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.546248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.546360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.546480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.546595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.546708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.546708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.546918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.547030 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.547150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.547264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.547377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.547489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.547601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.547720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.547841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.547956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.548068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.548068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.548277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.548398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.548519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.548633 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.548746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.548858 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.548970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.549091 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.549216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.549330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.549443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.549555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.549667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.549781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.549900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.550014 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.550127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.550239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.550354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.550467 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.550587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.550701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.550814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.550926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.551039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.551151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.551271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.551385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.551497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.551609 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.551722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.551835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.551975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.552092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.552205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.552317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.552430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.552542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.552663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.552777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.552891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.553004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.553149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.553261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.553384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.553499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.553611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.553724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.553836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.553949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.554070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.554184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.554296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.554408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.554520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.554632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.554752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.554866 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.554979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.555091 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.555203 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.555315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.555435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.555549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.555661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.555773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.555885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.555997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.556118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.556232 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.556344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.556457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.556569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.556681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.556801 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.556915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.557045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.557161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.557274 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.557386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.557510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.557626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.557744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.557858 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.557971 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.558083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.558204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.558318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.558430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.558549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.558668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.558790 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.558904 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.559017 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.559129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.559243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.559355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.559475 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.559589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.559701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] role.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.559814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.559926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] role.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.560038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.560222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.560343 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.560457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.560570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.560683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.560802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.560923 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.561081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.561197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.561311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.561423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.561535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] role.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.561660 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.561775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] role.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.561888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.562000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.562113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.562224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.562346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.562460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.562579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.562693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.562805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.562917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.563038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.563152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.563265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.563378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.563497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.563610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.563733 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.563847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.563960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.564072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.564184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.564297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.564421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.564536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.564648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.564761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.564873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.564994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.565128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.565241 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.565354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.565467 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.565579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.565579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.565803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.565915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.566027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.566139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.566251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.566370 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.566484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.566598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.566710 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.566822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.566934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.567054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.567167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.567279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.567391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.567503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.567689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.567835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.567953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.568067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.568181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.568294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.568407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.568528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.568646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.568760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.568874 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.568987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.569129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.569257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.569373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.569486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.569599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.569714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.569827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.569827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.569827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.570153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.570267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.570382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.570496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.570618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.570734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.570847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.570961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.571073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.571186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.571307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.571421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.571535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.571659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.571783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.571899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.572011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.572132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.572246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.connection = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.572359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.572472 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.572585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.572697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.572819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.572933 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.573108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.573234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.573358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.573473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.573587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.573699 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.573699 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.573922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.connection = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.574035 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.574233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.574352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.574465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.574587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.574701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.574814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.574929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.575042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.575155 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.575279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.575395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.575508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.575621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.575735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.575848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.575970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576312 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576424 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:13:16.576774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:13:16.576774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:13:16.604853 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.605102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.605328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.605413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.605558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.605789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.613632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.614102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.641891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.642117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.642690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.642919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.694679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.695262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.743622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.743851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.744292 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.744528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.897676 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.897894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.898034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.898120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.898237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.898346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.898457 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.898540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.898673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.898754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.898889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.899104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.922127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.922228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.922357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.922508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.922589 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.922663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.922788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.922871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.923006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.923090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.923220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.923301 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.923430 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.923521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.935222 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.935357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.947937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.948165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.948329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.948329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.948481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.948558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.948635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.948711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.948797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.948915 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.949002 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.949151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81559) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.949237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.949357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81558) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:13:16.966227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.966365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.966451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:13:16.966573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:13:16.966765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.966913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.966998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:13:16.967111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:13:16.967231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.967386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.967478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.967648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.967730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.967983 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.968158 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.968422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.978214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.978328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.978494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.978579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.978769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.978867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.979054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.979138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.985998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:16.986083 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:16.988876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:16.988960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:16.989181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.989263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.990047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.990134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.990351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.990424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.990636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.990728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.990893 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.990984 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.991161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.991242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.991433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.991513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.991703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.991814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.991979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.992087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.992249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:16.992354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.014846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.015051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.016304 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.016512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.016593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.016794 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.021679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.021965 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.022251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.023036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.023321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.023607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.028693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.028980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.030148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.030429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.034604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.034694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.034900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.034982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.035183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.035277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.035462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.035545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.035734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.035815 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.036024 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.036106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.036295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.036862 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.037119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.037238 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.052724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.052987 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.053103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.053287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.056867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.057165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.060084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.060377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.060458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.060673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.064597 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.064900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.068254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.068578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.071479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.071777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.071859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.072073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.072156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.072368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.072459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.072654 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.072735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.072933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.073030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.073250 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.089021 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.089309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.089574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.089658 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.089835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.089926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.090121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.090387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.096668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.097231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.098236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.098781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.100335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.100605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.100862 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.101169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.103243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.103526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.103803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.103911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.104094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.104183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.104379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.104461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.104663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.105096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.115719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.116006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.116283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.116369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.116575 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.116659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.116856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.116939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.117161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.117246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.117504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.117587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.117832 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.118113 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.133587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.134196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.136489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.137150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.139391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.140051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.140819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.141526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.142458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.142740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.143005 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.143086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.143289 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.143704 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.149473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.150152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.150940 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.151620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.153967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.154258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.154484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.154566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.154812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.154914 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.155152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.155439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.163148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.163435 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.163716 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.163798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.164037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.164321 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.171413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81559) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.171508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81558) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:13:17.171700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.171783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.171984 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.172066 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.172258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.172346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.172530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.172613 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.172802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.172883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.173104 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.173212 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.173419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.173501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.173704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.173785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.173970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.174051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.174240 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.174366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.174505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.174586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.174767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.174846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.175027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81558) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.175115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81559) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:13:17.209576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a7f6d659c0 pid: 81558 (default app) Nov 02 07:13:17.209744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a7f6d659c0 pid: 81559 (default app) Nov 02 07:13:17.213028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af73f8-b30a-4b5a-a472-31841ff17d3c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:17.213329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af73f8-b30a-4b5a-a472-31841ff17d3c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:17.213601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af73f8-b30a-4b5a-a472-31841ff17d3c None None] PATH_INFO: `/v3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:17.217742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Wed Nov 2 07:13:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:24.026843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835927bd-435f-4298-b2e5-1aa6a9ce0b8d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:24.027355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835927bd-435f-4298-b2e5-1aa6a9ce0b8d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:24.027437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835927bd-435f-4298-b2e5-1aa6a9ce0b8d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:24.031665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:13:24.037022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:24.037521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:24.037748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:24.108568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: INFO dbcounter [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] Registered counter for database keystone Nov 02 07:13:24.128974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG oslo_db.sqlalchemy.engines [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:13:24.136017 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writer thread running {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:13:24.316590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG passlib.handlers.bcrypt [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81558) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 07:13:24.316985 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG passlib.handlers.bcrypt [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81558) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 07:13:24.375855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:24.377488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:24.503485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 07:13:24.807226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835927bd-435f-4298-b2e5-1aa6a9ce0b8d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:24.876581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: INFO dbcounter [None req-835927bd-435f-4298-b2e5-1aa6a9ce0b8d None None] Registered counter for database keystone Nov 02 07:13:24.898387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG oslo_db.sqlalchemy.engines [None req-835927bd-435f-4298-b2e5-1aa6a9ce0b8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:13:24.904538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writer thread running {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:13:25.023849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835927bd-435f-4298-b2e5-1aa6a9ce0b8d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:25.028139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec1ae1-dbaf-48b4-b36e-9977bf8b9502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:25.028749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec1ae1-dbaf-48b4-b36e-9977bf8b9502 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:25.029044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec1ae1-dbaf-48b4-b36e-9977bf8b9502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:25.029322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec1ae1-dbaf-48b4-b36e-9977bf8b9502 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:25.037594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec1ae1-dbaf-48b4-b36e-9977bf8b9502 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:25.090369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WARNING keystone.common.rbac_enforcer.enforcer [None req-62ec1ae1-dbaf-48b4-b36e-9977bf8b9502 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 07:13:25.090712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec1ae1-dbaf-48b4-b36e-9977bf8b9502 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:25.100319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 2 07:13:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:13:25.106293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:25.122727 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39b687-9a02-4cf7-97a7-a8a69d92b719 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:25.127134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e44c3a-c181-439e-ad05-56ef9be6c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:25.128231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e44c3a-c181-439e-ad05-56ef9be6c43e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:25.128510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e44c3a-c181-439e-ad05-56ef9be6c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:25.128784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e44c3a-c181-439e-ad05-56ef9be6c43e admin admin] PATH_INFO: `/v3/projects/2e777bb62ed84954afdd571094319647` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:25.133132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e44c3a-c181-439e-ad05-56ef9be6c43e admin admin] RBAC: Authorizing `identity:get_project(project_id=2e777bb62ed84954afdd571094319647)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:25.184393 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a8e44c3a-c181-439e-ad05-56ef9be6c43e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 07:13:25.184735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e44c3a-c181-439e-ad05-56ef9be6c43e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:25.189240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 07:13:25 2022] GET /identity/v3/projects/2e777bb62ed84954afdd571094319647 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:27.385860 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0900e9-be1a-4e17-a2ed-c0204159064a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:27.386418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0900e9-be1a-4e17-a2ed-c0204159064a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:27.386418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0900e9-be1a-4e17-a2ed-c0204159064a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:27.390474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:27.395893 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36874272-e6e6-485f-b908-a7d5af157d55 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:27.396403 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36874272-e6e6-485f-b908-a7d5af157d55 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:27.397058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36874272-e6e6-485f-b908-a7d5af157d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:27.417712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-36874272-e6e6-485f-b908-a7d5af157d55 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:27.419221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-36874272-e6e6-485f-b908-a7d5af157d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:27.427256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 07:13:27.699267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0900e9-be1a-4e17-a2ed-c0204159064a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:27.712061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0900e9-be1a-4e17-a2ed-c0204159064a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:27.716510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8988b4-876d-457a-abc3-c71f389d7f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:27.717126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8988b4-876d-457a-abc3-c71f389d7f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:27.717402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8988b4-876d-457a-abc3-c71f389d7f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:27.717671 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8988b4-876d-457a-abc3-c71f389d7f63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:27.725394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8988b4-876d-457a-abc3-c71f389d7f63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:27.727178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8988b4-876d-457a-abc3-c71f389d7f63 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:27.735721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Wed Nov 2 07:13:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:13:27.741602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36874272-e6e6-485f-b908-a7d5af157d55 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:27.750616 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36874272-e6e6-485f-b908-a7d5af157d55 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:27.754964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81df29-17de-4bc9-91d7-b1d76b10144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:27.755588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81df29-17de-4bc9-91d7-b1d76b10144b admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:27.756493 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81df29-17de-4bc9-91d7-b1d76b10144b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:27.756783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81df29-17de-4bc9-91d7-b1d76b10144b admin admin] PATH_INFO: `/v3/users/0b9b00efe9544adbaaf4dd7abbf7b385` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:27.758134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81df29-17de-4bc9-91d7-b1d76b10144b admin admin] RBAC: Authorizing `identity:get_user(user_id=0b9b00efe9544adbaaf4dd7abbf7b385)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:27.759942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81df29-17de-4bc9-91d7-b1d76b10144b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:27.761511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Wed Nov 2 07:13:27 2022] GET /identity/v3/users/0b9b00efe9544adbaaf4dd7abbf7b385 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:13:29.939286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497f19-90cb-4637-837f-7690d8c3af23 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:29.939772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497f19-90cb-4637-837f-7690d8c3af23 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:29.939881 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497f19-90cb-4637-837f-7690d8c3af23 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:29.941154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:29.946479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5842be-44ec-483b-a817-596e5baff41a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:29.946906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5842be-44ec-483b-a817-596e5baff41a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:29.947186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5842be-44ec-483b-a817-596e5baff41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:29.965152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-bc5842be-44ec-483b-a817-596e5baff41a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:29.966321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bc5842be-44ec-483b-a817-596e5baff41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:30.011850 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0595-b778-471f-b991-1d3afae90c40 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:30.012134 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0595-b778-471f-b991-1d3afae90c40 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:30.012407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0595-b778-471f-b991-1d3afae90c40 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:30.013791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:13:30.019162 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29226c9-e3a2-47a4-9bee-85f97f91f76f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:30.019442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29226c9-e3a2-47a4-9bee-85f97f91f76f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:30.019712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29226c9-e3a2-47a4-9bee-85f97f91f76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:30.049439 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:13:30.063048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG passlib.handlers.bcrypt [None req-f29226c9-e3a2-47a4-9bee-85f97f91f76f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81559) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 07:13:30.063448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG passlib.handlers.bcrypt [None req-f29226c9-e3a2-47a4-9bee-85f97f91f76f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81559) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 07:13:30.113182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f29226c9-e3a2-47a4-9bee-85f97f91f76f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:30.114757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f29226c9-e3a2-47a4-9bee-85f97f91f76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:30.215175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:13:30.319982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5842be-44ec-483b-a817-596e5baff41a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:30.345149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:30.424019 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5842be-44ec-483b-a817-596e5baff41a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:30.456898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2264a3-2285-413e-806d-a0eedf768e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:30.457557 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2264a3-2285-413e-806d-a0eedf768e29 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:30.457834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2264a3-2285-413e-806d-a0eedf768e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:30.458104 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2264a3-2285-413e-806d-a0eedf768e29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:30.469455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2264a3-2285-413e-806d-a0eedf768e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-6f2264a3-2285-413e-806d-a0eedf768e29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:30.478615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:30.479507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:30.480437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:13:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:30.485547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29226c9-e3a2-47a4-9bee-85f97f91f76f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:30.488597 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2264a3-2285-413e-806d-a0eedf768e29 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:30.570253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:30.587801 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29226c9-e3a2-47a4-9bee-85f97f91f76f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:30.589174 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2264a3-2285-413e-806d-a0eedf768e29 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:30.590386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:30.623272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab21db-852f-4a79-b028-b4e3c4b5763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:30.623877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab21db-852f-4a79-b028-b4e3c4b5763b None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:30.624152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab21db-852f-4a79-b028-b4e3c4b5763b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:30.624423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab21db-852f-4a79-b028-b4e3c4b5763b None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:30.625129 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab21db-852f-4a79-b028-b4e3c4b5763b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:30.626525 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab21db-852f-4a79-b028-b4e3c4b5763b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:30.626887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cadf0-ab23-420b-8d7c-9a17656d25b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:30.627821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cadf0-ab23-420b-8d7c-9a17656d25b9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:30.628104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cadf0-ab23-420b-8d7c-9a17656d25b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:30.628380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cadf0-ab23-420b-8d7c-9a17656d25b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:30.629260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cadf0-ab23-420b-8d7c-9a17656d25b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:30.629565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cadf0-ab23-420b-8d7c-9a17656d25b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:30.631501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cadf0-ab23-420b-8d7c-9a17656d25b9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:30.636784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.sql.core [None req-52ab21db-852f-4a79-b028-b4e3c4b5763b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:13:30.636784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:13:30.636784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [parameters: {'id': '3d8865aec65b439e990f3cc2560430d3', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:13:30.636784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81558) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:13:30.643418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:30.649271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cadf0-ab23-420b-8d7c-9a17656d25b9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-52ab21db-852f-4a79-b028-b4e3c4b5763b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:13:30.654453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result.read() Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:13:30.655476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application yield resource Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise self.value Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application session.commit() Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:13:30.656600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:13:30.657596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:13:30.658485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result.read() Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:13:30.659208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [parameters: {'id': '3d8865aec65b439e990f3cc2560430d3', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:13:30.660023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:30.661148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 8/16] 10.222.0.13 () {60 vars in 1137 bytes} [Wed Nov 2 07:13:30 2022] POST /identity/v3/domains => generated 190 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:13:30.663485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab21db-852f-4a79-b028-b4e3c4b5763b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:30.749065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cadf0-ab23-420b-8d7c-9a17656d25b9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:30.759602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab21db-852f-4a79-b028-b4e3c4b5763b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:30.781911 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb8e2-d7c1-43af-9b95-af3aa0ebf97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:30.782761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb8e2-d7c1-43af-9b95-af3aa0ebf97a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:30.783033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb8e2-d7c1-43af-9b95-af3aa0ebf97a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:30.783300 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcb8e2-d7c1-43af-9b95-af3aa0ebf97a None admin] PATH_INFO: `/v3/users/0b9b00efe9544adbaaf4dd7abbf7b385` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:30.784896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb8e2-d7c1-43af-9b95-af3aa0ebf97a None admin] RBAC: Authorizing `identity:get_user(user_id=0b9b00efe9544adbaaf4dd7abbf7b385)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:30.786369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcb8e2-d7c1-43af-9b95-af3aa0ebf97a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:30.787980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:30 2022] GET /identity/v3/users/0b9b00efe9544adbaaf4dd7abbf7b385 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:13:30.792759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aed7d-82d0-4798-9fb9-580f7577fd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:30.793480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aed7d-82d0-4798-9fb9-580f7577fd63 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:30.793574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb8e2-d7c1-43af-9b95-af3aa0ebf97a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:30.793756 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aed7d-82d0-4798-9fb9-580f7577fd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:30.794024 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aed7d-82d0-4798-9fb9-580f7577fd63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:30.804704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33aed7d-82d0-4798-9fb9-580f7577fd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:30.806190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33aed7d-82d0-4798-9fb9-580f7577fd63 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:30.814949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-a33aed7d-82d0-4798-9fb9-580f7577fd63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:13:30.824469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:30.825683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:13:30.826689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:13:30.826689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:13:30.826689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:30.828513 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:30.830478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:30.834760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aed7d-82d0-4798-9fb9-580f7577fd63 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:30.895949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcb8e2-d7c1-43af-9b95-af3aa0ebf97a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:30.932840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aed7d-82d0-4798-9fb9-580f7577fd63 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:30.934145 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b84e-797f-406b-a14b-e09188d2d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:30.934772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b84e-797f-406b-a14b-e09188d2d367 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:30.935045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b84e-797f-406b-a14b-e09188d2d367 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:30.935314 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b84e-797f-406b-a14b-e09188d2d367 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:30.936412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b84e-797f-406b-a14b-e09188d2d367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:30.937872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b84e-797f-406b-a14b-e09188d2d367 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:30.939405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:13:30.945313 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b84e-797f-406b-a14b-e09188d2d367 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:30.967361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58207e-1a86-4826-b2df-10de2e42827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:30.967966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58207e-1a86-4826-b2df-10de2e42827d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:30.968242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58207e-1a86-4826-b2df-10de2e42827d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:30.968510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58207e-1a86-4826-b2df-10de2e42827d None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:30.969188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58207e-1a86-4826-b2df-10de2e42827d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:30.969494 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58207e-1a86-4826-b2df-10de2e42827d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:30.970884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58207e-1a86-4826-b2df-10de2e42827d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:30.987575 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:13:31.048653 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b84e-797f-406b-a14b-e09188d2d367 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:31.050311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:31.085248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab2967-23b4-4896-b95d-8417ce92818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:31.085922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2967-23b4-4896-b95d-8417ce92818f None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:31.086196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2967-23b4-4896-b95d-8417ce92818f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:31.086466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab2967-23b4-4896-b95d-8417ce92818f None admin] PATH_INFO: `/v3/domains/default/users/0b9b00efe9544adbaaf4dd7abbf7b385/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:31.088715 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab2967-23b4-4896-b95d-8417ce92818f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0b9b00efe9544adbaaf4dd7abbf7b385, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:31.090225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab2967-23b4-4896-b95d-8417ce92818f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:31.209351 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 11/21] 10.222.0.13 () {58 vars in 1361 bytes} [Wed Nov 2 07:13:30 2022] PUT /identity/v3/domains/default/users/0b9b00efe9544adbaaf4dd7abbf7b385/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:13:33.716548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9f9c4-f3d8-4a7f-bdb8-1f0bdb86168d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:33.717569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9f9c4-f3d8-4a7f-bdb8-1f0bdb86168d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:33.718050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9f9c4-f3d8-4a7f-bdb8-1f0bdb86168d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:33.719574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:33.726414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1884-a526-4bc6-a265-32d264aead6e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:33.726929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1884-a526-4bc6-a265-32d264aead6e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:33.727004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1884-a526-4bc6-a265-32d264aead6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:33.750741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-251f1884-a526-4bc6-a265-32d264aead6e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:33.752288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-251f1884-a526-4bc6-a265-32d264aead6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:33.761160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4db8a-5054-4e7a-ae70-3e610a7a74b6 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:33.761760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4db8a-5054-4e7a-ae70-3e610a7a74b6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:33.762247 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4db8a-5054-4e7a-ae70-3e610a7a74b6 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:33.763767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 12/23] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:33.769172 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979ce99-a17d-476e-90d9-98918668b973 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:33.769713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979ce99-a17d-476e-90d9-98918668b973 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:33.770192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979ce99-a17d-476e-90d9-98918668b973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:33.802014 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8979ce99-a17d-476e-90d9-98918668b973 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:33.804050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8979ce99-a17d-476e-90d9-98918668b973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:33.884750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 12/24] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:33.886078 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d63aa-fd79-4852-824a-669fbe886b88 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:33.886369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d63aa-fd79-4852-824a-669fbe886b88 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:33.886645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d63aa-fd79-4852-824a-669fbe886b88 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:33.890780 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 13/25] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:33.926539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d9cf-7898-42e4-8fe8-3a3b987af401 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:33.927191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d9cf-7898-42e4-8fe8-3a3b987af401 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:33.928198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d9cf-7898-42e4-8fe8-3a3b987af401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:33.942795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:33.970147 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2186d9cf-7898-42e4-8fe8-3a3b987af401 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:33.971673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2186d9cf-7898-42e4-8fe8-3a3b987af401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:33.978890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 13/26] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:13:34.111296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 14/27] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:34.312102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979ce99-a17d-476e-90d9-98918668b973 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:34.336556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fea27-9fa3-4007-af56-2488317d8554 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:34.337206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fea27-9fa3-4007-af56-2488317d8554 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:34.337708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fea27-9fa3-4007-af56-2488317d8554 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:34.339490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 15/28] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:34.351776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7c40-441c-4f1c-9782-8d5745518cdc None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:34.352340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7c40-441c-4f1c-9782-8d5745518cdc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:34.352820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7c40-441c-4f1c-9782-8d5745518cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:34.390026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2eff7c40-441c-4f1c-9782-8d5745518cdc None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:34.391588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2eff7c40-441c-4f1c-9782-8d5745518cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:34.439880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:34.470693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979ce99-a17d-476e-90d9-98918668b973 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:34.511910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0964f-e762-483f-89c9-4aecf644e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:34.512887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0964f-e762-483f-89c9-4aecf644e611 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:34.513426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0964f-e762-483f-89c9-4aecf644e611 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:34.513882 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0964f-e762-483f-89c9-4aecf644e611 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:34.514740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0964f-e762-483f-89c9-4aecf644e611 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:34.516494 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0964f-e762-483f-89c9-4aecf644e611 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:34.529138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 16/29] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:34.530336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff7c40-441c-4f1c-9782-8d5745518cdc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:34.680112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 14/30] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Nov 2 07:13:34 2022] POST /identity/v3/roles => generated 225 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:13:34.681413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0964f-e762-483f-89c9-4aecf644e611 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:34.704557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff7c40-441c-4f1c-9782-8d5745518cdc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:34.755306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3e8c5-3a16-4ec3-8939-de5771ba938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:34.756165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e8c5-3a16-4ec3-8939-de5771ba938e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:34.757086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e8c5-3a16-4ec3-8939-de5771ba938e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:34.757372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e8c5-3a16-4ec3-8939-de5771ba938e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:34.794338 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3e8c5-3a16-4ec3-8939-de5771ba938e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:34.809407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-28b3e8c5-3a16-4ec3-8939-de5771ba938e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:34.814224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:34.815288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:13:34.816257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 17/31] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:34.836014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3e8c5-3a16-4ec3-8939-de5771ba938e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:34.882887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:34.978117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0964f-e762-483f-89c9-4aecf644e611 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:34.995527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3e8c5-3a16-4ec3-8939-de5771ba938e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:35.040112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7942d1-ff73-46ef-888b-c7da16a55b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:35.041163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7942d1-ff73-46ef-888b-c7da16a55b40 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.042242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7942d1-ff73-46ef-888b-c7da16a55b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.043864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7942d1-ff73-46ef-888b-c7da16a55b40 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.044774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7942d1-ff73-46ef-888b-c7da16a55b40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:35.046366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7942d1-ff73-46ef-888b-c7da16a55b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:35.048132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7942d1-ff73-46ef-888b-c7da16a55b40 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:35.056149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257148-a01c-46ff-9a47-3ed601f801b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:35.056799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257148-a01c-46ff-9a47-3ed601f801b0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.057129 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257148-a01c-46ff-9a47-3ed601f801b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.057403 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257148-a01c-46ff-9a47-3ed601f801b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.061424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 18/32] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:35.066662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7942d1-ff73-46ef-888b-c7da16a55b40 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:35.072925 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9257148-a01c-46ff-9a47-3ed601f801b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:35.074854 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9257148-a01c-46ff-9a47-3ed601f801b0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-f9257148-a01c-46ff-9a47-3ed601f801b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:13:35.094305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:35.095216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:13:35.096007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:13:35.096007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:13:35.096007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:35.098665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 15/33] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:35.099931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257148-a01c-46ff-9a47-3ed601f801b0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:35.167628 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:35.204860 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7942d1-ff73-46ef-888b-c7da16a55b40 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:35.219825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:35.222991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257148-a01c-46ff-9a47-3ed601f801b0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:35.242478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86acc0a-447d-4470-88a8-92c36b1bdc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:35.243017 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86acc0a-447d-4470-88a8-92c36b1bdc16 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.243296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86acc0a-447d-4470-88a8-92c36b1bdc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.243570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86acc0a-447d-4470-88a8-92c36b1bdc16 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.244233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86acc0a-447d-4470-88a8-92c36b1bdc16 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:35.245639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86acc0a-447d-4470-88a8-92c36b1bdc16 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:35.259456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb2d13-1f16-4cc9-b832-cc49a0b5d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:35.260094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb2d13-1f16-4cc9-b832-cc49a0b5d786 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.260378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb2d13-1f16-4cc9-b832-cc49a0b5d786 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.260740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb2d13-1f16-4cc9-b832-cc49a0b5d786 None admin] PATH_INFO: `/v3/users/0b9b00efe9544adbaaf4dd7abbf7b385` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.261915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb2d13-1f16-4cc9-b832-cc49a0b5d786 None admin] RBAC: Authorizing `identity:get_user(user_id=0b9b00efe9544adbaaf4dd7abbf7b385)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:35.262288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 19/34] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Nov 2 07:13:35 2022] POST /identity/v3/roles => generated 219 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:13:35.263363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb2d13-1f16-4cc9-b832-cc49a0b5d786 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:35.264939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 16/35] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:35 2022] GET /identity/v3/users/0b9b00efe9544adbaaf4dd7abbf7b385 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:35.270187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86acc0a-447d-4470-88a8-92c36b1bdc16 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:35.271069 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a34888-2e53-4ccc-bd6a-6d6c7d45f8ed None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.271368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a34888-2e53-4ccc-bd6a-6d6c7d45f8ed None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.272240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a34888-2e53-4ccc-bd6a-6d6c7d45f8ed None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.274045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 17/36] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:35.274838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a34888-2e53-4ccc-bd6a-6d6c7d45f8ed None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:35.398365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86acc0a-447d-4470-88a8-92c36b1bdc16 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:35.436007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a34888-2e53-4ccc-bd6a-6d6c7d45f8ed None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:35.440403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d73af-3298-4595-9754-1a4ffbdd3fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:35.440675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d73af-3298-4595-9754-1a4ffbdd3fda None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.440824 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d73af-3298-4595-9754-1a4ffbdd3fda None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.441232 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d73af-3298-4595-9754-1a4ffbdd3fda None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.442077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d73af-3298-4595-9754-1a4ffbdd3fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:35.442380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d73af-3298-4595-9754-1a4ffbdd3fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:35.444616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d73af-3298-4595-9754-1a4ffbdd3fda None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:35.447584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:35.471355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 20/37] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:35.472613 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167d012-925c-47ad-accd-b569ec2b9c81 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.472962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167d012-925c-47ad-accd-b569ec2b9c81 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.473895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167d012-925c-47ad-accd-b569ec2b9c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.484471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe8034-4739-49cf-92c8-a4117b72f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:35.485146 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe8034-4739-49cf-92c8-a4117b72f81a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.485426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe8034-4739-49cf-92c8-a4117b72f81a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.485699 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe8034-4739-49cf-92c8-a4117b72f81a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.486821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe8034-4739-49cf-92c8-a4117b72f81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:35.488744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe8034-4739-49cf-92c8-a4117b72f81a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:35.491148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 18/38] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:35.492204 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb74d9-19dd-4aaf-8c64-431b7d7817a4 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.492593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb74d9-19dd-4aaf-8c64-431b7d7817a4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.492849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb74d9-19dd-4aaf-8c64-431b7d7817a4 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.494090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 19/39] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:35.494772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb74d9-19dd-4aaf-8c64-431b7d7817a4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:35.494975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2167d012-925c-47ad-accd-b569ec2b9c81 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:35.496164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2167d012-925c-47ad-accd-b569ec2b9c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:35.534523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:35.567205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 21/40] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:35.568055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167d012-925c-47ad-accd-b569ec2b9c81 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:35.603703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb74d9-19dd-4aaf-8c64-431b7d7817a4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:35.646305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e906ab-33f1-444e-ac83-abaf6ae539c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:35.647551 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e906ab-33f1-444e-ac83-abaf6ae539c8 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.647844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e906ab-33f1-444e-ac83-abaf6ae539c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.648114 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e906ab-33f1-444e-ac83-abaf6ae539c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.648766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e906ab-33f1-444e-ac83-abaf6ae539c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:35.650274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e906ab-33f1-444e-ac83-abaf6ae539c8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:35.681110 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:13:35 2022] POST /identity/v3/projects => generated 301 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:13:35.682341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86650a9-a99e-4c75-8e7c-b314e99ff357 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.682636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86650a9-a99e-4c75-8e7c-b314e99ff357 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.682942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86650a9-a99e-4c75-8e7c-b314e99ff357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.683774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167d012-925c-47ad-accd-b569ec2b9c81 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:35.710732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a86650a9-a99e-4c75-8e7c-b314e99ff357 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:35.712303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a86650a9-a99e-4c75-8e7c-b314e99ff357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:35.722210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:35.736108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671aae3-b712-4b39-8f26-2939bfa2736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:35.737197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671aae3-b712-4b39-8f26-2939bfa2736e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:35.737785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671aae3-b712-4b39-8f26-2939bfa2736e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:35.738213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671aae3-b712-4b39-8f26-2939bfa2736e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:35.739060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671aae3-b712-4b39-8f26-2939bfa2736e None admin] RBAC: Adding query filter params (role.id=6a01757540e64fed9041997458bd64e5, scope.domain.id=default, user.id=0b9b00efe9544adbaaf4dd7abbf7b385) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:35.739498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671aae3-b712-4b39-8f26-2939bfa2736e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:35.742044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671aae3-b712-4b39-8f26-2939bfa2736e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:35.751678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 22/42] 10.222.0.13 () {56 vars in 1322 bytes} [Wed Nov 2 07:13:35 2022] GET /identity/v3/role_assignments?user.id=0b9b00efe9544adbaaf4dd7abbf7b385&scope.domain.id=default&role.id=6a01757540e64fed9041997458bd64e5 => generated 530 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:35.798265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 21/43] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:35.843624 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671aae3-b712-4b39-8f26-2939bfa2736e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:35.966146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671aae3-b712-4b39-8f26-2939bfa2736e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:36.004514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c57088-d850-440a-a3e7-7cc7644b03b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:36.005480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c57088-d850-440a-a3e7-7cc7644b03b0 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:36.006071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c57088-d850-440a-a3e7-7cc7644b03b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:36.006541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c57088-d850-440a-a3e7-7cc7644b03b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:36.007403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c57088-d850-440a-a3e7-7cc7644b03b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:36.008964 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c57088-d850-440a-a3e7-7cc7644b03b0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:36.025499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Nov 2 07:13:35 2022] POST /identity/v3/roles => generated 223 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:13:36.083426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86650a9-a99e-4c75-8e7c-b314e99ff357 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:36.102722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:36.190363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86650a9-a99e-4c75-8e7c-b314e99ff357 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:36.329570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ee51e-f4ba-4f8d-9a28-eb43a0b670f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:36.330189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ee51e-f4ba-4f8d-9a28-eb43a0b670f7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:36.330468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ee51e-f4ba-4f8d-9a28-eb43a0b670f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:36.330740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ee51e-f4ba-4f8d-9a28-eb43a0b670f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:36.331832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ee51e-f4ba-4f8d-9a28-eb43a0b670f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:36.333274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ee51e-f4ba-4f8d-9a28-eb43a0b670f7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:36.334846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 22/45] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:36.340706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c57088-d850-440a-a3e7-7cc7644b03b0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:36.389212 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:36.439243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c57088-d850-440a-a3e7-7cc7644b03b0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:36.471003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a1772-2857-4b6d-8d38-47db3e9c53e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:36.471597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a1772-2857-4b6d-8d38-47db3e9c53e3 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:36.471875 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a1772-2857-4b6d-8d38-47db3e9c53e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:36.472147 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a1772-2857-4b6d-8d38-47db3e9c53e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:36.472790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a1772-2857-4b6d-8d38-47db3e9c53e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:36.474267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a1772-2857-4b6d-8d38-47db3e9c53e3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:36.507142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:13:36 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:13:38.634307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebfbb8-62ab-4c91-b16f-4960c22c19e9 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:38.634817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebfbb8-62ab-4c91-b16f-4960c22c19e9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:38.634899 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebfbb8-62ab-4c91-b16f-4960c22c19e9 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:38.636221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 23/47] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:38.641480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ab215-9250-48fc-b4e4-1a583b200936 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:38.641846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ab215-9250-48fc-b4e4-1a583b200936 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:38.642035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ab215-9250-48fc-b4e4-1a583b200936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:38.660373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b47ab215-9250-48fc-b4e4-1a583b200936 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:38.661585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b47ab215-9250-48fc-b4e4-1a583b200936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:38.728480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:38.998522 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebfbb8-62ab-4c91-b16f-4960c22c19e9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:39.082419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:39.098168 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebfbb8-62ab-4c91-b16f-4960c22c19e9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:39.130592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661d71b-c7a7-492d-ac45-4fa99a5272e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:39.131381 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d71b-c7a7-492d-ac45-4fa99a5272e0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:39.131662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d71b-c7a7-492d-ac45-4fa99a5272e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:39.131937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d71b-c7a7-492d-ac45-4fa99a5272e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:39.133061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661d71b-c7a7-492d-ac45-4fa99a5272e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:39.134498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661d71b-c7a7-492d-ac45-4fa99a5272e0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:39.136035 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 24/49] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:39.141536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ab215-9250-48fc-b4e4-1a583b200936 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:39.171620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:39.239941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ab215-9250-48fc-b4e4-1a583b200936 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:39.273798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623e559-d04c-402e-8872-79dc068965b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:39.274394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e559-d04c-402e-8872-79dc068965b6 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:39.274673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e559-d04c-402e-8872-79dc068965b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:39.274945 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e559-d04c-402e-8872-79dc068965b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:39.275590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623e559-d04c-402e-8872-79dc068965b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:39.277047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623e559-d04c-402e-8872-79dc068965b6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:39.301091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1140 bytes} [Wed Nov 2 07:13:39 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:13:41.438736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0136f4a-167b-434c-96ca-fbfafdcfa26c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:41.439269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0136f4a-167b-434c-96ca-fbfafdcfa26c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:41.439269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0136f4a-167b-434c-96ca-fbfafdcfa26c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:41.440597 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 25/51] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:41.446424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f462-b864-4549-ae8f-34681efd89c3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:41.446825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f462-b864-4549-ae8f-34681efd89c3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:41.446976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f462-b864-4549-ae8f-34681efd89c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:41.465000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-08f2f462-b864-4549-ae8f-34681efd89c3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:41.466208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-08f2f462-b864-4549-ae8f-34681efd89c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:41.529393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 27/52] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:41.810549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0136f4a-167b-434c-96ca-fbfafdcfa26c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:41.909802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0136f4a-167b-434c-96ca-fbfafdcfa26c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:41.941813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80b43f-ab8d-4250-9611-610dec089024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:41.942456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80b43f-ab8d-4250-9611-610dec089024 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:41.942734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80b43f-ab8d-4250-9611-610dec089024 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:41.943014 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80b43f-ab8d-4250-9611-610dec089024 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:41.944603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80b43f-ab8d-4250-9611-610dec089024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:41.946064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80b43f-ab8d-4250-9611-610dec089024 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:41.947599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:41.953265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2f462-b864-4549-ae8f-34681efd89c3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:41.967854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:42.052031 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2f462-b864-4549-ae8f-34681efd89c3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:42.187674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54348df-70df-4a31-8ccd-db1af125e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:42.188176 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54348df-70df-4a31-8ccd-db1af125e33f None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:42.188454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54348df-70df-4a31-8ccd-db1af125e33f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:42.188727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54348df-70df-4a31-8ccd-db1af125e33f None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:42.189406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54348df-70df-4a31-8ccd-db1af125e33f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:42.190804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54348df-70df-4a31-8ccd-db1af125e33f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:42.217077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 28/54] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:13:41 2022] POST /identity/v3/users => generated 275 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:13:45.488185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4b79e-e40e-4770-9908-421eae843802 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:45.489240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4b79e-e40e-4770-9908-421eae843802 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:45.489725 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4b79e-e40e-4770-9908-421eae843802 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:45.491735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 27/55] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:45.497074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85c1fc-4802-4c1d-9487-42a1dec494d7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:45.497983 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85c1fc-4802-4c1d-9487-42a1dec494d7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:45.498478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85c1fc-4802-4c1d-9487-42a1dec494d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:45.522072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-fb85c1fc-4802-4c1d-9487-42a1dec494d7 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:45.523734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fb85c1fc-4802-4c1d-9487-42a1dec494d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:45.608509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:45.614303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 29/56] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:45.683151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09777794-e440-4fbd-bf67-cb7371ac32bc None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:45.683789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09777794-e440-4fbd-bf67-cb7371ac32bc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:45.684257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09777794-e440-4fbd-bf67-cb7371ac32bc None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:45.685827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 28/57] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:45.691474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e88d1-5f4c-4236-ba5e-99279e77a8d8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:45.691762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e88d1-5f4c-4236-ba5e-99279e77a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:45.692041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e88d1-5f4c-4236-ba5e-99279e77a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:45.722801 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cf1e88d1-5f4c-4236-ba5e-99279e77a8d8 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:45.724281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cf1e88d1-5f4c-4236-ba5e-99279e77a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:45.725453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198023-ac0c-4539-b588-acf08ec28caa None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:45.725937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198023-ac0c-4539-b588-acf08ec28caa None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:45.726426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198023-ac0c-4539-b588-acf08ec28caa None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:45.727945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 29/58] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:45.741555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af153206-6de3-41ad-a8ef-15576ebcaf54 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:45.742105 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af153206-6de3-41ad-a8ef-15576ebcaf54 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:45.742573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af153206-6de3-41ad-a8ef-15576ebcaf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:45.761807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-af153206-6de3-41ad-a8ef-15576ebcaf54 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:45.763523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-af153206-6de3-41ad-a8ef-15576ebcaf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:45.784404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:45.852329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:45.854368 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 30/60] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:45.973919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1637db-9502-4da5-8cc2-4f1807c2b14c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:45.974519 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1637db-9502-4da5-8cc2-4f1807c2b14c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:45.975056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1637db-9502-4da5-8cc2-4f1807c2b14c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:45.976593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 31/61] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:45.981864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6862a-9914-4137-8771-1ff87e4bac56 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:45.982152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6862a-9914-4137-8771-1ff87e4bac56 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:45.982428 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6862a-9914-4137-8771-1ff87e4bac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.009284 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7be6862a-9914-4137-8771-1ff87e4bac56 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:46.010395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7be6862a-9914-4137-8771-1ff87e4bac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:46.014824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1637db-9502-4da5-8cc2-4f1807c2b14c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:46.134679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1637db-9502-4da5-8cc2-4f1807c2b14c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:46.148044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 31/62] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:46.171906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6682a-7907-4ebd-9a86-7c3fd74bfe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:46.172825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6682a-7907-4ebd-9a86-7c3fd74bfe0d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.173336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6682a-7907-4ebd-9a86-7c3fd74bfe0d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.173820 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6682a-7907-4ebd-9a86-7c3fd74bfe0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.184710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6682a-7907-4ebd-9a86-7c3fd74bfe0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3da6682a-7907-4ebd-9a86-7c3fd74bfe0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:46.189816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:46.190683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:13:46.191414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:46.194280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 32/63] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:13:46.200329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6862a-9914-4137-8771-1ff87e4bac56 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:46.237575 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6682a-7907-4ebd-9a86-7c3fd74bfe0d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:46.261212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:46.288047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:46.337511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6862a-9914-4137-8771-1ff87e4bac56 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:46.374305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6682a-7907-4ebd-9a86-7c3fd74bfe0d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:46.384112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127c5f7-2273-409b-bc55-c645bac478b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:46.384719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127c5f7-2273-409b-bc55-c645bac478b0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.384995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127c5f7-2273-409b-bc55-c645bac478b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.385667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127c5f7-2273-409b-bc55-c645bac478b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.386334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127c5f7-2273-409b-bc55-c645bac478b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:46.386916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127c5f7-2273-409b-bc55-c645bac478b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:46.388370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127c5f7-2273-409b-bc55-c645bac478b0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:46.398578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 32/64] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:46.400419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127c5f7-2273-409b-bc55-c645bac478b0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:46.415417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee58f0-2110-4df0-9afe-4c9886646058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:46.416203 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee58f0-2110-4df0-9afe-4c9886646058 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.416488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee58f0-2110-4df0-9afe-4c9886646058 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.416759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee58f0-2110-4df0-9afe-4c9886646058 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.427624 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee58f0-2110-4df0-9afe-4c9886646058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-a9ee58f0-2110-4df0-9afe-4c9886646058 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:46.432476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:46.433410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:46.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 33/65] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:13:46.434787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee5c1-429a-4253-9448-5c48c6c7a687 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.435012 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee5c1-429a-4253-9448-5c48c6c7a687 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.435283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee5c1-429a-4253-9448-5c48c6c7a687 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.437825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 34/66] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:46.442352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ee5c1-429a-4253-9448-5c48c6c7a687 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:46.510131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127c5f7-2273-409b-bc55-c645bac478b0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:46.514512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:46.530938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:46.543908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ee5c1-429a-4253-9448-5c48c6c7a687 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:46.544444 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e4020-5c80-442b-a367-8d748fe29126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:46.545096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e4020-5c80-442b-a367-8d748fe29126 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.545419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e4020-5c80-442b-a367-8d748fe29126 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.545691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e4020-5c80-442b-a367-8d748fe29126 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.556169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e4020-5c80-442b-a367-8d748fe29126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d06e4020-5c80-442b-a367-8d748fe29126 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:46.560926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:46.562106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:13:46.562856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 33/67] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:46.567480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e4020-5c80-442b-a367-8d748fe29126 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:46.577427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18092a6f-d6f1-4ab3-97d1-d8d6d9f6d420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:46.578054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18092a6f-d6f1-4ab3-97d1-d8d6d9f6d420 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.578332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18092a6f-d6f1-4ab3-97d1-d8d6d9f6d420 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.578601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18092a6f-d6f1-4ab3-97d1-d8d6d9f6d420 None admin] PATH_INFO: `/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.592235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18092a6f-d6f1-4ab3-97d1-d8d6d9f6d420 None admin] RBAC: Authorizing `identity:get_user(user_id=7bf4a26de2df41a6a5813c08ab4c6bec)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:46.593725 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18092a6f-d6f1-4ab3-97d1-d8d6d9f6d420 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:46.595321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 35/68] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:46.596065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18092a6f-d6f1-4ab3-97d1-d8d6d9f6d420 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:46.665625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e4020-5c80-442b-a367-8d748fe29126 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:46.695834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18092a6f-d6f1-4ab3-97d1-d8d6d9f6d420 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:46.698560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd334329-4f4e-48d8-bffc-78eecc9a37c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:46.699181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd334329-4f4e-48d8-bffc-78eecc9a37c3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.699453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd334329-4f4e-48d8-bffc-78eecc9a37c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.699719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd334329-4f4e-48d8-bffc-78eecc9a37c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.710018 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd334329-4f4e-48d8-bffc-78eecc9a37c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-cd334329-4f4e-48d8-bffc-78eecc9a37c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:46.715315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:46.716177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:46.717691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23502278-8348-4e3b-adca-6b72256c3380 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.718365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23502278-8348-4e3b-adca-6b72256c3380 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.718365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23502278-8348-4e3b-adca-6b72256c3380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.726414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:46.732345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b9fbd-d28f-4b8b-8437-3a580df324e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:46.732951 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b9fbd-d28f-4b8b-8437-3a580df324e8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.733261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b9fbd-d28f-4b8b-8437-3a580df324e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.733534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b9fbd-d28f-4b8b-8437-3a580df324e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.734200 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b9fbd-d28f-4b8b-8437-3a580df324e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:46.734497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b9fbd-d28f-4b8b-8437-3a580df324e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:46.735808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-23502278-8348-4e3b-adca-6b72256c3380 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:46.735905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b9fbd-d28f-4b8b-8437-3a580df324e8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:46.736987 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-23502278-8348-4e3b-adca-6b72256c3380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:46.747549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:46.748344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b9fbd-d28f-4b8b-8437-3a580df324e8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:46.776620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:46.808951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 35/71] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:46.809800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23502278-8348-4e3b-adca-6b72256c3380 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:46.853187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b9fbd-d28f-4b8b-8437-3a580df324e8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:46.892737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68b95-c615-407f-a5ae-2088d72931ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:46.893386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68b95-c615-407f-a5ae-2088d72931ca None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.893652 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68b95-c615-407f-a5ae-2088d72931ca None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68b95-c615-407f-a5ae-2088d72931ca None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.894644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68b95-c615-407f-a5ae-2088d72931ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:46.895085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68b95-c615-407f-a5ae-2088d72931ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:46.896318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68b95-c615-407f-a5ae-2088d72931ca None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:46.906627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 37/72] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:46.907243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68b95-c615-407f-a5ae-2088d72931ca None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:46.928434 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23502278-8348-4e3b-adca-6b72256c3380 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:46.965375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bbfe2-bdbe-4a02-ac19-40344892ed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:46.966003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bbfe2-bdbe-4a02-ac19-40344892ed63 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:46.966297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bbfe2-bdbe-4a02-ac19-40344892ed63 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:46.966703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bbfe2-bdbe-4a02-ac19-40344892ed63 None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:46.967504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:46.967851 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bbfe2-bdbe-4a02-ac19-40344892ed63 None admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:46.969350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bbfe2-bdbe-4a02-ac19-40344892ed63 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:46.971751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:46.972607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bbfe2-bdbe-4a02-ac19-40344892ed63 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.014892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:47.025968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68b95-c615-407f-a5ae-2088d72931ca None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.061683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a54f7-ea4e-4c10-854c-092c1751e447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.062295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a54f7-ea4e-4c10-854c-092c1751e447 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.062578 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a54f7-ea4e-4c10-854c-092c1751e447 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.062855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a54f7-ea4e-4c10-854c-092c1751e447 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.063512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a54f7-ea4e-4c10-854c-092c1751e447 None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:47.063820 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a54f7-ea4e-4c10-854c-092c1751e447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.065229 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a54f7-ea4e-4c10-854c-092c1751e447 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.073941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 38/74] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:47.074745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a54f7-ea4e-4c10-854c-092c1751e447 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.086521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bbfe2-bdbe-4a02-ac19-40344892ed63 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.120550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a926b-9d2a-4714-ba4e-97d319ca54c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.121214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a926b-9d2a-4714-ba4e-97d319ca54c6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.121494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a926b-9d2a-4714-ba4e-97d319ca54c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.121766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a926b-9d2a-4714-ba4e-97d319ca54c6 None admin] PATH_INFO: `/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.122894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a926b-9d2a-4714-ba4e-97d319ca54c6 None admin] RBAC: Authorizing `identity:get_user(user_id=7bf4a26de2df41a6a5813c08ab4c6bec)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.124337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a926b-9d2a-4714-ba4e-97d319ca54c6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.126142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:46 2022] GET /identity/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:47.126671 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a926b-9d2a-4714-ba4e-97d319ca54c6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.179183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a54f7-ea4e-4c10-854c-092c1751e447 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.194645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:47.212401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70f516-a916-474e-ab6e-f92969c354fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.213053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70f516-a916-474e-ab6e-f92969c354fe None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.213334 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70f516-a916-474e-ab6e-f92969c354fe None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.213602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70f516-a916-474e-ab6e-f92969c354fe None admin] PATH_INFO: `/v3/users/0b9b00efe9544adbaaf4dd7abbf7b385` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.214968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70f516-a916-474e-ab6e-f92969c354fe None admin] RBAC: Authorizing `identity:get_user(user_id=0b9b00efe9544adbaaf4dd7abbf7b385)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.216416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70f516-a916-474e-ab6e-f92969c354fe None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.218219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 39/76] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:47 2022] GET /identity/v3/users/0b9b00efe9544adbaaf4dd7abbf7b385 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:47.218748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70f516-a916-474e-ab6e-f92969c354fe None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.229095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a926b-9d2a-4714-ba4e-97d319ca54c6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.236066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:47.262845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d032422-5353-46ee-a1ff-b1a52dadc7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.263494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d032422-5353-46ee-a1ff-b1a52dadc7a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.263768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d032422-5353-46ee-a1ff-b1a52dadc7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.264035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d032422-5353-46ee-a1ff-b1a52dadc7a7 None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a/users/7bf4a26de2df41a6a5813c08ab4c6bec/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.265974 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d032422-5353-46ee-a1ff-b1a52dadc7a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=18b9124303d64d28bc970b0635e31a5a, user_id=7bf4a26de2df41a6a5813c08ab4c6bec, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.267410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d032422-5353-46ee-a1ff-b1a52dadc7a7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.281788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 38/77] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:13:47 2022] PUT /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a/users/7bf4a26de2df41a6a5813c08ab4c6bec/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:13:47.282785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d032422-5353-46ee-a1ff-b1a52dadc7a7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.332600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70f516-a916-474e-ab6e-f92969c354fe None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.373366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c633c1c-aaa8-432d-a79b-ba720b83af1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.374016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c633c1c-aaa8-432d-a79b-ba720b83af1c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.374340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c633c1c-aaa8-432d-a79b-ba720b83af1c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.374573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c633c1c-aaa8-432d-a79b-ba720b83af1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.375793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c633c1c-aaa8-432d-a79b-ba720b83af1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.377561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c633c1c-aaa8-432d-a79b-ba720b83af1c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.379386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 40/78] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:47.380125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c633c1c-aaa8-432d-a79b-ba720b83af1c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.393894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d032422-5353-46ee-a1ff-b1a52dadc7a7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.434989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5378e4d-9476-4a09-a9b6-73e38076d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.435638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5378e4d-9476-4a09-a9b6-73e38076d951 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.435918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5378e4d-9476-4a09-a9b6-73e38076d951 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.436186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5378e4d-9476-4a09-a9b6-73e38076d951 None admin] PATH_INFO: `/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.437396 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5378e4d-9476-4a09-a9b6-73e38076d951 None admin] RBAC: Authorizing `identity:get_user(user_id=7bf4a26de2df41a6a5813c08ab4c6bec)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.438596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:47.439075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5378e4d-9476-4a09-a9b6-73e38076d951 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.440999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 39/79] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:47 2022] GET /identity/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:47.445963 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5378e4d-9476-4a09-a9b6-73e38076d951 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.485555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:47.497681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c633c1c-aaa8-432d-a79b-ba720b83af1c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.532636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923a8e5-3b9a-499f-9d7f-7ad5c27b0bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.533370 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923a8e5-3b9a-499f-9d7f-7ad5c27b0bcf None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.533652 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923a8e5-3b9a-499f-9d7f-7ad5c27b0bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.533929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923a8e5-3b9a-499f-9d7f-7ad5c27b0bcf None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.535087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923a8e5-3b9a-499f-9d7f-7ad5c27b0bcf None admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.536563 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923a8e5-3b9a-499f-9d7f-7ad5c27b0bcf None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.539234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 41/80] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:47 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:47.540009 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923a8e5-3b9a-499f-9d7f-7ad5c27b0bcf None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.562714 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5378e4d-9476-4a09-a9b6-73e38076d951 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.602986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d4699-462e-4985-8bd2-c2e57ab0b36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.603535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d4699-462e-4985-8bd2-c2e57ab0b36d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.603822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d4699-462e-4985-8bd2-c2e57ab0b36d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.604095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d4699-462e-4985-8bd2-c2e57ab0b36d None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.605245 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d4699-462e-4985-8bd2-c2e57ab0b36d None admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.606681 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d4699-462e-4985-8bd2-c2e57ab0b36d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.608641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 40/81] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:47 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:47.609440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d4699-462e-4985-8bd2-c2e57ab0b36d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.654153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923a8e5-3b9a-499f-9d7f-7ad5c27b0bcf None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.676709 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:47.692789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021001a9-246a-42ea-98e6-b60e03da2cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.693438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021001a9-246a-42ea-98e6-b60e03da2cf7 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.693715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021001a9-246a-42ea-98e6-b60e03da2cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.694087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021001a9-246a-42ea-98e6-b60e03da2cf7 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.694744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021001a9-246a-42ea-98e6-b60e03da2cf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.696218 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021001a9-246a-42ea-98e6-b60e03da2cf7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.726649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d4699-462e-4985-8bd2-c2e57ab0b36d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.728409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:47.730171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 42/82] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:13:47 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:13:47.731033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021001a9-246a-42ea-98e6-b60e03da2cf7 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.788217 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbd45c-23f6-476d-863b-10fa8984d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.789047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbd45c-23f6-476d-863b-10fa8984d250 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.789326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbd45c-23f6-476d-863b-10fa8984d250 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.789594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbd45c-23f6-476d-863b-10fa8984d250 None admin] PATH_INFO: `/v3/projects/31e6051dcf524b9da5a4d55b79add4ed` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.790769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbd45c-23f6-476d-863b-10fa8984d250 None admin] RBAC: Authorizing `identity:get_project(project_id=31e6051dcf524b9da5a4d55b79add4ed)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.792229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbd45c-23f6-476d-863b-10fa8984d250 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.794344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 41/83] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:47 2022] GET /identity/v3/projects/31e6051dcf524b9da5a4d55b79add4ed => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:47.795491 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbd45c-23f6-476d-863b-10fa8984d250 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.870725 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021001a9-246a-42ea-98e6-b60e03da2cf7 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.915751 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3852d46-c615-4d3b-a165-53e0fe104401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.917602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852d46-c615-4d3b-a165-53e0fe104401 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.917602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852d46-c615-4d3b-a165-53e0fe104401 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.917780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852d46-c615-4d3b-a165-53e0fe104401 None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a/users/7bf4a26de2df41a6a5813c08ab4c6bec/roles/2ba82c8be98e49f3a4e424556cab4bd3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.921579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3852d46-c615-4d3b-a165-53e0fe104401 None admin] RBAC: Authorizing `identity:create_grant(project_id=18b9124303d64d28bc970b0635e31a5a, user_id=7bf4a26de2df41a6a5813c08ab4c6bec, role_id=2ba82c8be98e49f3a4e424556cab4bd3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.923219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3852d46-c615-4d3b-a165-53e0fe104401 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.923308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbd45c-23f6-476d-863b-10fa8984d250 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:47.947188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 43/84] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:13:47 2022] PUT /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a/users/7bf4a26de2df41a6a5813c08ab4c6bec/roles/2ba82c8be98e49f3a4e424556cab4bd3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:13:47.948012 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3852d46-c615-4d3b-a165-53e0fe104401 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:47.977550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07f532-6f01-435e-86f3-d1166a24b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:47.978469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f532-6f01-435e-86f3-d1166a24b539 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:47.978823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f532-6f01-435e-86f3-d1166a24b539 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:47.979096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f532-6f01-435e-86f3-d1166a24b539 None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a/users/0b9b00efe9544adbaaf4dd7abbf7b385/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:47.982164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07f532-6f01-435e-86f3-d1166a24b539 None admin] RBAC: Authorizing `identity:create_grant(project_id=18b9124303d64d28bc970b0635e31a5a, user_id=0b9b00efe9544adbaaf4dd7abbf7b385, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:47.984685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07f532-6f01-435e-86f3-d1166a24b539 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:47.997215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:48.009735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 42/85] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:13:47 2022] PUT /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a/users/0b9b00efe9544adbaaf4dd7abbf7b385/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:13:48.094407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3852d46-c615-4d3b-a165-53e0fe104401 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:48.143864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e78ac-eaa8-4a9f-bb57-ffbe227df90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:48.144474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e78ac-eaa8-4a9f-bb57-ffbe227df90f None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:48.144754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e78ac-eaa8-4a9f-bb57-ffbe227df90f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:48.145157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e78ac-eaa8-4a9f-bb57-ffbe227df90f None admin] PATH_INFO: `/v3/projects/31e6051dcf524b9da5a4d55b79add4ed/users/7bf4a26de2df41a6a5813c08ab4c6bec/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:48.147950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e78ac-eaa8-4a9f-bb57-ffbe227df90f None admin] RBAC: Authorizing `identity:create_grant(project_id=31e6051dcf524b9da5a4d55b79add4ed, user_id=7bf4a26de2df41a6a5813c08ab4c6bec, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:48.149685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e78ac-eaa8-4a9f-bb57-ffbe227df90f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:48.170211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 44/86] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:13:47 2022] PUT /identity/v3/projects/31e6051dcf524b9da5a4d55b79add4ed/users/7bf4a26de2df41a6a5813c08ab4c6bec/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:13:49.761151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4820987-ac48-4738-9653-2ae84603587d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:49.761656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4820987-ac48-4738-9653-2ae84603587d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:49.761756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4820987-ac48-4738-9653-2ae84603587d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:49.763283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 43/87] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:49.778154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368349-9dae-48b3-bffe-df0dc17265f0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:49.778651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368349-9dae-48b3-bffe-df0dc17265f0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:49.778724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368349-9dae-48b3-bffe-df0dc17265f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:49.801964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-85368349-9dae-48b3-bffe-df0dc17265f0 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:49.803163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-85368349-9dae-48b3-bffe-df0dc17265f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:49.893373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 45/88] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:50.458970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4820987-ac48-4738-9653-2ae84603587d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:50.508855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:50.612087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4820987-ac48-4738-9653-2ae84603587d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:50.651058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e1b8f-88f5-4f18-b262-9d5a44f0186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:50.652041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e1b8f-88f5-4f18-b262-9d5a44f0186c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:50.652518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e1b8f-88f5-4f18-b262-9d5a44f0186c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:50.652980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e1b8f-88f5-4f18-b262-9d5a44f0186c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:50.663779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e1b8f-88f5-4f18-b262-9d5a44f0186c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-512e1b8f-88f5-4f18-b262-9d5a44f0186c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:50.669154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:50.669973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:13:50.670721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:13:50.672883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 44/89] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:50.682110 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85368349-9dae-48b3-bffe-df0dc17265f0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:50.726052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:50.824678 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85368349-9dae-48b3-bffe-df0dc17265f0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:50.874184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c102-16a2-440b-ba49-d7f8ab82b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:50.874802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c102-16a2-440b-ba49-d7f8ab82b03e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:50.875083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c102-16a2-440b-ba49-d7f8ab82b03e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:50.875355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c102-16a2-440b-ba49-d7f8ab82b03e None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:50.876031 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82c102-16a2-440b-ba49-d7f8ab82b03e None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:50.876335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82c102-16a2-440b-ba49-d7f8ab82b03e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:50.877761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82c102-16a2-440b-ba49-d7f8ab82b03e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:50.893088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 46/90] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:13:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:50.899396 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e1b8f-88f5-4f18-b262-9d5a44f0186c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:51.087784 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:51.104008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e1b8f-88f5-4f18-b262-9d5a44f0186c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:51.149727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598a00d-73b5-4901-9cff-e6b50da33e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:51.150376 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a00d-73b5-4901-9cff-e6b50da33e34 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.150658 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a00d-73b5-4901-9cff-e6b50da33e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.150933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a00d-73b5-4901-9cff-e6b50da33e34 None admin] PATH_INFO: `/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.152121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598a00d-73b5-4901-9cff-e6b50da33e34 None admin] RBAC: Authorizing `identity:get_user(user_id=7bf4a26de2df41a6a5813c08ab4c6bec)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:51.153619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598a00d-73b5-4901-9cff-e6b50da33e34 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:51.155693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 45/91] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:50 2022] GET /identity/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:51.161290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c102-16a2-440b-ba49-d7f8ab82b03e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:51.180466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dca0cb-db61-4e04-a308-e93a4f93ee80 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.180990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dca0cb-db61-4e04-a308-e93a4f93ee80 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.181507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dca0cb-db61-4e04-a308-e93a4f93ee80 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.185071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 46/92] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:51.189331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd72c2d-2209-4bde-a505-722df240ecf6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.189619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd72c2d-2209-4bde-a505-722df240ecf6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.189900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd72c2d-2209-4bde-a505-722df240ecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.223281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-dfd72c2d-2209-4bde-a505-722df240ecf6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:51.227513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dfd72c2d-2209-4bde-a505-722df240ecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:51.336560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 47/93] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:13:51.340709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d0c11-f7c1-4fa4-8697-cfe9c4818f3a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.341258 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d0c11-f7c1-4fa4-8697-cfe9c4818f3a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.341361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:51.341819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d0c11-f7c1-4fa4-8697-cfe9c4818f3a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.343375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 48/94] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:51.357811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086af745-079f-4f90-a847-d42a4725b790 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.361194 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086af745-079f-4f90-a847-d42a4725b790 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.361684 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086af745-079f-4f90-a847-d42a4725b790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.373113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c102-16a2-440b-ba49-d7f8ab82b03e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:51.399590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-086af745-079f-4f90-a847-d42a4725b790 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:51.401584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-086af745-079f-4f90-a847-d42a4725b790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:51.462538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3ef65-e87c-4b44-94a1-d7d69c421fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:51.463191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3ef65-e87c-4b44-94a1-d7d69c421fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.463476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3ef65-e87c-4b44-94a1-d7d69c421fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.465711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3ef65-e87c-4b44-94a1-d7d69c421fa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.518205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 49/95] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:13:51.619136 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3ef65-e87c-4b44-94a1-d7d69c421fa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:51.619302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3ef65-e87c-4b44-94a1-d7d69c421fa0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:51.639783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937752f-6054-4d3e-a79c-d38661722f43 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.640405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937752f-6054-4d3e-a79c-d38661722f43 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.640746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937752f-6054-4d3e-a79c-d38661722f43 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.642223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 50/96] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:13:51.643334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d3310-bd8f-4922-90f0-531436be954b None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.643685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d3310-bd8f-4922-90f0-531436be954b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.644025 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d3310-bd8f-4922-90f0-531436be954b None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.649281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 51/97] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:51.650670 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af683a2e-bdaf-4e72-a369-e3fa848a057b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.651014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af683a2e-bdaf-4e72-a369-e3fa848a057b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.651358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af683a2e-bdaf-4e72-a369-e3fa848a057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.682026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-af683a2e-bdaf-4e72-a369-e3fa848a057b None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:51.683351 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-af683a2e-bdaf-4e72-a369-e3fa848a057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:51.701857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:51.783819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 52/98] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:51.785120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945073c-ad05-4edf-b927-d8d17fb673c6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.785405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945073c-ad05-4edf-b927-d8d17fb673c6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.785680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945073c-ad05-4edf-b927-d8d17fb673c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.802238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:51.815804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d945073c-ad05-4edf-b927-d8d17fb673c6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:51.816503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 47/99] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:13:51.817961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d945073c-ad05-4edf-b927-d8d17fb673c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:51.826007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3ef65-e87c-4b44-94a1-d7d69c421fa0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:51.918344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 53/100] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:51.921811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf2ce8-e1e3-4097-a3aa-cafe921e0211 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:51.921811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf2ce8-e1e3-4097-a3aa-cafe921e0211 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:51.921811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf2ce8-e1e3-4097-a3aa-cafe921e0211 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:51.921811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 54/101] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:51.922373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf2ce8-e1e3-4097-a3aa-cafe921e0211 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:51.997535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3ef65-e87c-4b44-94a1-d7d69c421fa0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.026567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:52.035073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfe942-a64d-4b68-ba80-ea8e63cc4a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.035865 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfe942-a64d-4b68-ba80-ea8e63cc4a21 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.036216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfe942-a64d-4b68-ba80-ea8e63cc4a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.036600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfe942-a64d-4b68-ba80-ea8e63cc4a21 None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.038247 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfe942-a64d-4b68-ba80-ea8e63cc4a21 None admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:52.040526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfe942-a64d-4b68-ba80-ea8e63cc4a21 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:52.042641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 48/102] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:51 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:52.043576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfe942-a64d-4b68-ba80-ea8e63cc4a21 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.056095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf2ce8-e1e3-4097-a3aa-cafe921e0211 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.094330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8bd60-2f1c-4129-ab2d-fb56c74f189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.094971 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8bd60-2f1c-4129-ab2d-fb56c74f189d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.095254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8bd60-2f1c-4129-ab2d-fb56c74f189d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.095530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8bd60-2f1c-4129-ab2d-fb56c74f189d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.108424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8bd60-2f1c-4129-ab2d-fb56c74f189d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-75f8bd60-2f1c-4129-ab2d-fb56c74f189d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:52.113353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:52.114234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:13:52.114999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:13:52.120739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 55/103] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:52.123724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:52.125644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669bcf-341f-41ed-82e1-6ed9f5292ee6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.126411 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669bcf-341f-41ed-82e1-6ed9f5292ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.126865 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669bcf-341f-41ed-82e1-6ed9f5292ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.150717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1b669bcf-341f-41ed-82e1-6ed9f5292ee6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:52.151949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1b669bcf-341f-41ed-82e1-6ed9f5292ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:52.177748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfe942-a64d-4b68-ba80-ea8e63cc4a21 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.216463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802fbb0-16fe-4b47-94d7-183951a30032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.217141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802fbb0-16fe-4b47-94d7-183951a30032 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.217534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802fbb0-16fe-4b47-94d7-183951a30032 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.217806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802fbb0-16fe-4b47-94d7-183951a30032 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.222535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 56/104] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:52.233165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b669bcf-341f-41ed-82e1-6ed9f5292ee6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.239687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802fbb0-16fe-4b47-94d7-183951a30032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-4802fbb0-16fe-4b47-94d7-183951a30032 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:52.245634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:52.246489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:52.247385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 49/105] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:52.252567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802fbb0-16fe-4b47-94d7-183951a30032 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.304514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:52.341329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b669bcf-341f-41ed-82e1-6ed9f5292ee6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.354570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802fbb0-16fe-4b47-94d7-183951a30032 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.375591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:52.376999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1676c7d-27aa-48f0-a6fe-77e2a964695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.377699 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1676c7d-27aa-48f0-a6fe-77e2a964695a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.377930 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1676c7d-27aa-48f0-a6fe-77e2a964695a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.378208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1676c7d-27aa-48f0-a6fe-77e2a964695a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.378940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1676c7d-27aa-48f0-a6fe-77e2a964695a None admin] RBAC: Adding query filter params (role.id=30142fe6cc4944d988168c210fc8c902, scope.project.id=18b9124303d64d28bc970b0635e31a5a, user.id=7bf4a26de2df41a6a5813c08ab4c6bec) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:52.379254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1676c7d-27aa-48f0-a6fe-77e2a964695a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:52.380707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1676c7d-27aa-48f0-a6fe-77e2a964695a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:52.397638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 57/106] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/role_assignments?user.id=7bf4a26de2df41a6a5813c08ab4c6bec&scope.project.id=18b9124303d64d28bc970b0635e31a5a&role.id=30142fe6cc4944d988168c210fc8c902 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:52.397638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1676c7d-27aa-48f0-a6fe-77e2a964695a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.409774 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feb2a6-fb7b-45f9-83c8-f14ce940ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.410548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb2a6-fb7b-45f9-83c8-f14ce940ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.410901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb2a6-fb7b-45f9-83c8-f14ce940ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.411245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb2a6-fb7b-45f9-83c8-f14ce940ffd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.412006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feb2a6-fb7b-45f9-83c8-f14ce940ffd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:52.412385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feb2a6-fb7b-45f9-83c8-f14ce940ffd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:52.414051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feb2a6-fb7b-45f9-83c8-f14ce940ffd4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:52.423661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 50/107] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:52.424809 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feb2a6-fb7b-45f9-83c8-f14ce940ffd4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.510583 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1676c7d-27aa-48f0-a6fe-77e2a964695a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.545264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:52.552040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0789f-43e9-4151-b917-710ac4294b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.552685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0789f-43e9-4151-b917-710ac4294b36 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.552964 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0789f-43e9-4151-b917-710ac4294b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.553308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0789f-43e9-4151-b917-710ac4294b36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.565370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0789f-43e9-4151-b917-710ac4294b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0bb0789f-43e9-4151-b917-710ac4294b36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:52.570951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:52.571878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:13:52.572645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:13:52.573270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feb2a6-fb7b-45f9-83c8-f14ce940ffd4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.573340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 58/108] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:52.573403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0789f-43e9-4151-b917-710ac4294b36 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.618155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcfccb-ac88-4023-8d4f-d813d1b2ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.618776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcfccb-ac88-4023-8d4f-d813d1b2ce4e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.619044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcfccb-ac88-4023-8d4f-d813d1b2ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.619313 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcfccb-ac88-4023-8d4f-d813d1b2ce4e None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.619972 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcfccb-ac88-4023-8d4f-d813d1b2ce4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:52.620270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcfccb-ac88-4023-8d4f-d813d1b2ce4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:52.621710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcfccb-ac88-4023-8d4f-d813d1b2ce4e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:52.630139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 51/109] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:52.634572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcfccb-ac88-4023-8d4f-d813d1b2ce4e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.677784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:52.684133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0789f-43e9-4151-b917-710ac4294b36 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.717797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea9ea9-f7e6-4121-84c8-de312e0355c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.718411 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea9ea9-f7e6-4121-84c8-de312e0355c5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.718687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea9ea9-f7e6-4121-84c8-de312e0355c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.719237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea9ea9-f7e6-4121-84c8-de312e0355c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.729476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea9ea9-f7e6-4121-84c8-de312e0355c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-27ea9ea9-f7e6-4121-84c8-de312e0355c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:52.734234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:52.735265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 59/110] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:52.736148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea9ea9-f7e6-4121-84c8-de312e0355c5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.739353 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcfccb-ac88-4023-8d4f-d813d1b2ce4e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.773684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2687a1-da7b-4613-8a60-8e2714c54fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.774269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2687a1-da7b-4613-8a60-8e2714c54fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.774546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2687a1-da7b-4613-8a60-8e2714c54fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.774817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2687a1-da7b-4613-8a60-8e2714c54fc1 None admin] PATH_INFO: `/v3/users/0b9b00efe9544adbaaf4dd7abbf7b385` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.775916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2687a1-da7b-4613-8a60-8e2714c54fc1 None admin] RBAC: Authorizing `identity:get_user(user_id=0b9b00efe9544adbaaf4dd7abbf7b385)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:52.777398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2687a1-da7b-4613-8a60-8e2714c54fc1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:52.778996 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 52/111] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/users/0b9b00efe9544adbaaf4dd7abbf7b385 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:52.779740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2687a1-da7b-4613-8a60-8e2714c54fc1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.791282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:52.838273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea9ea9-f7e6-4121-84c8-de312e0355c5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.872495 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d834cc-0009-4679-a9dd-6a035f7d4356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.873157 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d834cc-0009-4679-a9dd-6a035f7d4356 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.873437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d834cc-0009-4679-a9dd-6a035f7d4356 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.873714 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d834cc-0009-4679-a9dd-6a035f7d4356 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.874867 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d834cc-0009-4679-a9dd-6a035f7d4356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:52.876356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d834cc-0009-4679-a9dd-6a035f7d4356 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:52.877963 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 60/112] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:52.878719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d834cc-0009-4679-a9dd-6a035f7d4356 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.882545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2687a1-da7b-4613-8a60-8e2714c54fc1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:52.891401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:52.919431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefee32-6861-43ff-a819-fe74d4870268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:52.920046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefee32-6861-43ff-a819-fe74d4870268 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:52.920327 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefee32-6861-43ff-a819-fe74d4870268 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:52.920603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefee32-6861-43ff-a819-fe74d4870268 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:52.921303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefee32-6861-43ff-a819-fe74d4870268 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:52.921610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefee32-6861-43ff-a819-fe74d4870268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:52.923021 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefee32-6861-43ff-a819-fe74d4870268 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:52.930878 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 53/113] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:52.931669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefee32-6861-43ff-a819-fe74d4870268 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:52.982901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d834cc-0009-4679-a9dd-6a035f7d4356 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:53.002059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:53.016732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06287aca-b9bf-491a-a1c9-0b64ad2efd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:53.017383 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06287aca-b9bf-491a-a1c9-0b64ad2efd84 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:53.017663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06287aca-b9bf-491a-a1c9-0b64ad2efd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:53.017935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06287aca-b9bf-491a-a1c9-0b64ad2efd84 None admin] PATH_INFO: `/v3/users/c13c43069eaf41a4965adc8898135bb8` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:53.033359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06287aca-b9bf-491a-a1c9-0b64ad2efd84 None admin] RBAC: Authorizing `identity:get_user(user_id=c13c43069eaf41a4965adc8898135bb8)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:53.034438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefee32-6861-43ff-a819-fe74d4870268 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:53.034749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06287aca-b9bf-491a-a1c9-0b64ad2efd84 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:53.036378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 61/114] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/users/c13c43069eaf41a4965adc8898135bb8 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:53.037229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06287aca-b9bf-491a-a1c9-0b64ad2efd84 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:53.072442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db7015-ea82-4b10-be07-ca135da1825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:53.073069 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db7015-ea82-4b10-be07-ca135da1825b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:53.073351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db7015-ea82-4b10-be07-ca135da1825b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:53.073622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db7015-ea82-4b10-be07-ca135da1825b None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:53.074381 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db7015-ea82-4b10-be07-ca135da1825b None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:53.074683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db7015-ea82-4b10-be07-ca135da1825b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:53.076051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db7015-ea82-4b10-be07-ca135da1825b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:53.084001 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 54/115] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:13:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:53.084836 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db7015-ea82-4b10-be07-ca135da1825b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:53.114673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:53.142271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06287aca-b9bf-491a-a1c9-0b64ad2efd84 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:53.176220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4e778-edc2-4568-b403-9ed8c3bce287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:53.176823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4e778-edc2-4568-b403-9ed8c3bce287 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:53.177126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4e778-edc2-4568-b403-9ed8c3bce287 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:53.177400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4e778-edc2-4568-b403-9ed8c3bce287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:53.181914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db7015-ea82-4b10-be07-ca135da1825b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:53.214096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031347d3-4ed4-4854-9c69-1c662ad33b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:53.214957 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031347d3-4ed4-4854-9c69-1c662ad33b1e None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:53.215231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031347d3-4ed4-4854-9c69-1c662ad33b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:53.215500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031347d3-4ed4-4854-9c69-1c662ad33b1e None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:53.216138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031347d3-4ed4-4854-9c69-1c662ad33b1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:53.217590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031347d3-4ed4-4854-9c69-1c662ad33b1e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:53.222200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:53.244592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 55/116] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:13:53 2022] POST /identity/v3/projects => generated 302 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:13:53.245580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031347d3-4ed4-4854-9c69-1c662ad33b1e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:53.246942 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4e778-edc2-4568-b403-9ed8c3bce287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:53.248401 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4e778-edc2-4568-b403-9ed8c3bce287 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:53.341692 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:53.361089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031347d3-4ed4-4854-9c69-1c662ad33b1e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:53.363500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 62/117] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:13:53.369104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4e778-edc2-4568-b403-9ed8c3bce287 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:53.406647 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06497d-760e-41e9-be97-afd71cf5d888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:53.407610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06497d-760e-41e9-be97-afd71cf5d888 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:53.408100 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06497d-760e-41e9-be97-afd71cf5d888 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:53.408554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06497d-760e-41e9-be97-afd71cf5d888 None admin] PATH_INFO: `/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:53.409973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06497d-760e-41e9-be97-afd71cf5d888 None admin] RBAC: Authorizing `identity:get_user(user_id=7bf4a26de2df41a6a5813c08ab4c6bec)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:53.411433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06497d-760e-41e9-be97-afd71cf5d888 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:53.417599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 56/118] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:53 2022] GET /identity/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:53.417599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06497d-760e-41e9-be97-afd71cf5d888 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:53.454100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:53.478885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4e778-edc2-4568-b403-9ed8c3bce287 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:53.517796 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039923-e1b5-42fe-a6f1-0f2b711ef11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:53.518540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039923-e1b5-42fe-a6f1-0f2b711ef11f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:53.518823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039923-e1b5-42fe-a6f1-0f2b711ef11f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:53.519103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039923-e1b5-42fe-a6f1-0f2b711ef11f None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:53.520219 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97039923-e1b5-42fe-a6f1-0f2b711ef11f None admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:53.521172 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06497d-760e-41e9-be97-afd71cf5d888 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:53.521780 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97039923-e1b5-42fe-a6f1-0f2b711ef11f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:53.524197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 63/119] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:53 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:53.524974 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039923-e1b5-42fe-a6f1-0f2b711ef11f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:53.560796 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c66d6b-f034-47a3-8976-4925cafd94f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:53.561465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c66d6b-f034-47a3-8976-4925cafd94f7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:53.561745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c66d6b-f034-47a3-8976-4925cafd94f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:53.562018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c66d6b-f034-47a3-8976-4925cafd94f7 None admin] PATH_INFO: `/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:53.563151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c66d6b-f034-47a3-8976-4925cafd94f7 None admin] RBAC: Authorizing `identity:get_user(user_id=7bf4a26de2df41a6a5813c08ab4c6bec)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:53.564588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c66d6b-f034-47a3-8976-4925cafd94f7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:53.571383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 57/120] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:53 2022] GET /identity/v3/users/7bf4a26de2df41a6a5813c08ab4c6bec => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:53.571383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c66d6b-f034-47a3-8976-4925cafd94f7 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:53.592151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:53.639871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039923-e1b5-42fe-a6f1-0f2b711ef11f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:53.669620 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c66d6b-f034-47a3-8976-4925cafd94f7 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:53.676356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a65cc-32db-4086-a4ab-167112bdd93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:53.677130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a65cc-32db-4086-a4ab-167112bdd93c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:53.677410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a65cc-32db-4086-a4ab-167112bdd93c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:53.677681 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a65cc-32db-4086-a4ab-167112bdd93c None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:53.679298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a65cc-32db-4086-a4ab-167112bdd93c None admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:53.680859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a65cc-32db-4086-a4ab-167112bdd93c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:53.687271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 64/121] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:53 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:53.687271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a65cc-32db-4086-a4ab-167112bdd93c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:53.702140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:53.711473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988bb24-eb9c-4bb3-92a9-43a65ecd2e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:53.712090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988bb24-eb9c-4bb3-92a9-43a65ecd2e17 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:53.712369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988bb24-eb9c-4bb3-92a9-43a65ecd2e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:53.712641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988bb24-eb9c-4bb3-92a9-43a65ecd2e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:53.787161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988bb24-eb9c-4bb3-92a9-43a65ecd2e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:53.788686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988bb24-eb9c-4bb3-92a9-43a65ecd2e17 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:53.799008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a65cc-32db-4086-a4ab-167112bdd93c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:53.810223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:53.841789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85b00-3e6e-4969-963f-4012576c5ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:53.842501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85b00-3e6e-4969-963f-4012576c5ce8 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:53.842732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85b00-3e6e-4969-963f-4012576c5ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:53.843013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85b00-3e6e-4969-963f-4012576c5ce8 None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a/users/c13c43069eaf41a4965adc8898135bb8/roles/897a5115997e4f9aa54ca31cde430c8f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:53.844924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85b00-3e6e-4969-963f-4012576c5ce8 None admin] RBAC: Authorizing `identity:create_grant(project_id=18b9124303d64d28bc970b0635e31a5a, user_id=c13c43069eaf41a4965adc8898135bb8, role_id=897a5115997e4f9aa54ca31cde430c8f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:53.846417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85b00-3e6e-4969-963f-4012576c5ce8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:53.860523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 65/122] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:13:53 2022] PUT /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a/users/c13c43069eaf41a4965adc8898135bb8/roles/897a5115997e4f9aa54ca31cde430c8f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:13:53.861124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85b00-3e6e-4969-963f-4012576c5ce8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:53.905110 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 58/123] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:13:53.916132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988bb24-eb9c-4bb3-92a9-43a65ecd2e17 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:53.978442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:54.013981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85b00-3e6e-4969-963f-4012576c5ce8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:54.045384 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988bb24-eb9c-4bb3-92a9-43a65ecd2e17 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:54.059788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3415e-bda4-423e-b2c1-ab3490e48623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:54.060402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3415e-bda4-423e-b2c1-ab3490e48623 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:54.060735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3415e-bda4-423e-b2c1-ab3490e48623 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:54.061098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3415e-bda4-423e-b2c1-ab3490e48623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:54.073140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:54.091033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7c48-a018-4867-9a47-8b94e59e7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:54.091813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7c48-a018-4867-9a47-8b94e59e7e82 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:54.092095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7c48-a018-4867-9a47-8b94e59e7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:54.092370 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7c48-a018-4867-9a47-8b94e59e7e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:54.093768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7c48-a018-4867-9a47-8b94e59e7e82 None admin] RBAC: Adding query filter params (role.id=6a01757540e64fed9041997458bd64e5, scope.project.id=18b9124303d64d28bc970b0635e31a5a, user.id=0b9b00efe9544adbaaf4dd7abbf7b385) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:54.094037 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7c48-a018-4867-9a47-8b94e59e7e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:54.095968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7c48-a018-4867-9a47-8b94e59e7e82 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:54.105534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 59/124] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:13:53 2022] GET /identity/v3/role_assignments?user.id=0b9b00efe9544adbaaf4dd7abbf7b385&scope.project.id=18b9124303d64d28bc970b0635e31a5a&role.id=6a01757540e64fed9041997458bd64e5 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:54.106511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7c48-a018-4867-9a47-8b94e59e7e82 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:54.141158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3415e-bda4-423e-b2c1-ab3490e48623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:54.142660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3415e-bda4-423e-b2c1-ab3490e48623 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:54.228247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:54.259338 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 66/125] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:13:54.265033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3415e-bda4-423e-b2c1-ab3490e48623 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:54.302601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7c48-a018-4867-9a47-8b94e59e7e82 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:54.381985 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db325fe0-c3be-44c1-88ac-3436447e455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:54.383713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db325fe0-c3be-44c1-88ac-3436447e455f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:54.384160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db325fe0-c3be-44c1-88ac-3436447e455f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:54.384598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db325fe0-c3be-44c1-88ac-3436447e455f None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:54.385918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3415e-bda4-423e-b2c1-ab3490e48623 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:54.386332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db325fe0-c3be-44c1-88ac-3436447e455f None admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:54.388296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db325fe0-c3be-44c1-88ac-3436447e455f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:54.391277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 60/126] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:54 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:54.401184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db325fe0-c3be-44c1-88ac-3436447e455f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:54.457134 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8aa39-ce41-4688-a5cd-015849733888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:54.458074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8aa39-ce41-4688-a5cd-015849733888 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:54.458350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8aa39-ce41-4688-a5cd-015849733888 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:54.458618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8aa39-ce41-4688-a5cd-015849733888 None admin] PATH_INFO: `/v3/projects/31e6051dcf524b9da5a4d55b79add4ed` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:54.459906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8aa39-ce41-4688-a5cd-015849733888 None admin] RBAC: Authorizing `identity:get_project(project_id=31e6051dcf524b9da5a4d55b79add4ed)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:54.462910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8aa39-ce41-4688-a5cd-015849733888 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:54.463029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 67/127] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:54 2022] GET /identity/v3/projects/31e6051dcf524b9da5a4d55b79add4ed => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:54.469146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8aa39-ce41-4688-a5cd-015849733888 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:54.489371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:54.526560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:54.559520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db325fe0-c3be-44c1-88ac-3436447e455f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:54.606085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f149a-22d1-4888-8dfa-d4e213a4ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:54.607129 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f149a-22d1-4888-8dfa-d4e213a4ad34 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:54.607589 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f149a-22d1-4888-8dfa-d4e213a4ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:54.608045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f149a-22d1-4888-8dfa-d4e213a4ad34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:54.608966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f149a-22d1-4888-8dfa-d4e213a4ad34 None admin] RBAC: Adding query filter params (role.id=2ba82c8be98e49f3a4e424556cab4bd3, scope.project.id=18b9124303d64d28bc970b0635e31a5a, user.id=7bf4a26de2df41a6a5813c08ab4c6bec) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:54.609323 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f149a-22d1-4888-8dfa-d4e213a4ad34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:54.609830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8aa39-ce41-4688-a5cd-015849733888 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:54.610806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f149a-22d1-4888-8dfa-d4e213a4ad34 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:54.617841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 61/128] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:13:54 2022] GET /identity/v3/role_assignments?user.id=7bf4a26de2df41a6a5813c08ab4c6bec&scope.project.id=18b9124303d64d28bc970b0635e31a5a&role.id=2ba82c8be98e49f3a4e424556cab4bd3 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:13:54.651516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34249dd0-4bcb-4ee3-9102-45f749eba337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:54.652059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249dd0-4bcb-4ee3-9102-45f749eba337 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:54.652336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249dd0-4bcb-4ee3-9102-45f749eba337 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:54.652664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249dd0-4bcb-4ee3-9102-45f749eba337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:54.653450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249dd0-4bcb-4ee3-9102-45f749eba337 None admin] RBAC: Adding query filter params (role.id=30142fe6cc4944d988168c210fc8c902, scope.project.id=31e6051dcf524b9da5a4d55b79add4ed, user.id=7bf4a26de2df41a6a5813c08ab4c6bec) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:54.653760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249dd0-4bcb-4ee3-9102-45f749eba337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:54.655271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249dd0-4bcb-4ee3-9102-45f749eba337 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:54.662409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 68/129] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:13:54 2022] GET /identity/v3/role_assignments?user.id=7bf4a26de2df41a6a5813c08ab4c6bec&scope.project.id=31e6051dcf524b9da5a4d55b79add4ed&role.id=30142fe6cc4944d988168c210fc8c902 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:13:55.467811 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4a8a-be81-45b8-822b-5e8a670e4165 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:55.468348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4a8a-be81-45b8-822b-5e8a670e4165 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:55.468348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4a8a-be81-45b8-822b-5e8a670e4165 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:55.469716 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 62/130] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:55.475100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc132e-4e0a-4e1b-9522-9876b9ecef8e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:55.475556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc132e-4e0a-4e1b-9522-9876b9ecef8e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:55.475917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc132e-4e0a-4e1b-9522-9876b9ecef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:55.494551 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-45cc132e-4e0a-4e1b-9522-9876b9ecef8e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:55.495724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-45cc132e-4e0a-4e1b-9522-9876b9ecef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:55.560970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 69/131] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:55.840064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4a8a-be81-45b8-822b-5e8a670e4165 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:55.942433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4a8a-be81-45b8-822b-5e8a670e4165 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:55.957942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:55.976423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcee30-27e8-48f0-9218-14f12b0f1bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:55.977081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcee30-27e8-48f0-9218-14f12b0f1bde None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:55.977366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcee30-27e8-48f0-9218-14f12b0f1bde None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:55.977636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcee30-27e8-48f0-9218-14f12b0f1bde None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:55.978734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcee30-27e8-48f0-9218-14f12b0f1bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:55.980162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcee30-27e8-48f0-9218-14f12b0f1bde None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:55.981749 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 63/132] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:55.987239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc132e-4e0a-4e1b-9522-9876b9ecef8e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:56.022038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:56.089361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc132e-4e0a-4e1b-9522-9876b9ecef8e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:56.122551 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c229cb-ac19-46a6-8115-b5962a477b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:56.123080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c229cb-ac19-46a6-8115-b5962a477b5c None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:56.123354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c229cb-ac19-46a6-8115-b5962a477b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:56.123621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c229cb-ac19-46a6-8115-b5962a477b5c None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:56.124269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c229cb-ac19-46a6-8115-b5962a477b5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:56.125723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c229cb-ac19-46a6-8115-b5962a477b5c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:56.139291 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23a12e-38b4-4f61-a36a-2a7de929317b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:56.139619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23a12e-38b4-4f61-a36a-2a7de929317b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:56.139897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23a12e-38b4-4f61-a36a-2a7de929317b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:56.141392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 64/133] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:13:56.145880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 70/134] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:13:55 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:13:56.149826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9f9d-c684-48b6-a8bf-041f3d6f82bc None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:56.150110 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9f9d-c684-48b6-a8bf-041f3d6f82bc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:56.150385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9f9d-c684-48b6-a8bf-041f3d6f82bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:56.170281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f43b9f9d-c684-48b6-a8bf-041f3d6f82bc None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:56.171525 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f43b9f9d-c684-48b6-a8bf-041f3d6f82bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:56.244216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 65/135] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:56.515267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c229cb-ac19-46a6-8115-b5962a477b5c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:56.617163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:56.628719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c229cb-ac19-46a6-8115-b5962a477b5c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:56.664557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e864287-6139-4e99-9e92-c10bdb717cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:56.665225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864287-6139-4e99-9e92-c10bdb717cbe None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:56.665553 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864287-6139-4e99-9e92-c10bdb717cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:56.665827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864287-6139-4e99-9e92-c10bdb717cbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:56.676459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e864287-6139-4e99-9e92-c10bdb717cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0e864287-6139-4e99-9e92-c10bdb717cbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:56.682139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:56.682997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:13:56.683762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 71/136] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:13:56.689208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b9f9d-c684-48b6-a8bf-041f3d6f82bc None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:56.797114 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b9f9d-c684-48b6-a8bf-041f3d6f82bc None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:56.813197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:56.834799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400ec81-7ec6-47cb-b15e-dbcfd6a6dcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:56.835411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ec81-7ec6-47cb-b15e-dbcfd6a6dcfc None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:56.835688 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ec81-7ec6-47cb-b15e-dbcfd6a6dcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:56.835954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ec81-7ec6-47cb-b15e-dbcfd6a6dcfc None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:56.836612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400ec81-7ec6-47cb-b15e-dbcfd6a6dcfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:56.836908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400ec81-7ec6-47cb-b15e-dbcfd6a6dcfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:56.838310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400ec81-7ec6-47cb-b15e-dbcfd6a6dcfc None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:56.847283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 66/137] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:13:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:56.853544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e864287-6139-4e99-9e92-c10bdb717cbe None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:56.962269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e864287-6139-4e99-9e92-c10bdb717cbe None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:57.002379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843b4f4-d898-4374-be6f-4a48866d9bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:57.003015 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843b4f4-d898-4374-be6f-4a48866d9bdd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:57.003308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843b4f4-d898-4374-be6f-4a48866d9bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:57.003568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843b4f4-d898-4374-be6f-4a48866d9bdd None admin] PATH_INFO: `/v3/users/c13c43069eaf41a4965adc8898135bb8` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:57.004709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843b4f4-d898-4374-be6f-4a48866d9bdd None admin] RBAC: Authorizing `identity:get_user(user_id=c13c43069eaf41a4965adc8898135bb8)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:57.006187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843b4f4-d898-4374-be6f-4a48866d9bdd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:57.008212 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 72/138] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:56 2022] GET /identity/v3/users/c13c43069eaf41a4965adc8898135bb8 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:57.013981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400ec81-7ec6-47cb-b15e-dbcfd6a6dcfc None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:57.117771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400ec81-7ec6-47cb-b15e-dbcfd6a6dcfc None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:57.158786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92442ff1-7599-4dc2-a384-434e26fde8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:57.159396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92442ff1-7599-4dc2-a384-434e26fde8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:57.159672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92442ff1-7599-4dc2-a384-434e26fde8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:57.159940 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92442ff1-7599-4dc2-a384-434e26fde8f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:57.218883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:57.233696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92442ff1-7599-4dc2-a384-434e26fde8f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:57.235081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92442ff1-7599-4dc2-a384-434e26fde8f9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:57.339478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 67/139] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:13:57.350091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843b4f4-d898-4374-be6f-4a48866d9bdd None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:57.373347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:57.453947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843b4f4-d898-4374-be6f-4a48866d9bdd None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:57.488536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff892f-e9a5-4076-9bb5-9a72a711c786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:57.489197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff892f-e9a5-4076-9bb5-9a72a711c786 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:57.489478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff892f-e9a5-4076-9bb5-9a72a711c786 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:57.489752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff892f-e9a5-4076-9bb5-9a72a711c786 None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:57.490908 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff892f-e9a5-4076-9bb5-9a72a711c786 None admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:57.492499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff892f-e9a5-4076-9bb5-9a72a711c786 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:57.494335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 73/140] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:57 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:57.499989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92442ff1-7599-4dc2-a384-434e26fde8f9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:57.577380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:57.601276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92442ff1-7599-4dc2-a384-434e26fde8f9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:57.635682 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42068b6-54d9-428f-993b-65d4e3439c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:57.636216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42068b6-54d9-428f-993b-65d4e3439c25 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:57.636491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42068b6-54d9-428f-993b-65d4e3439c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:57.636764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42068b6-54d9-428f-993b-65d4e3439c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:57.637517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42068b6-54d9-428f-993b-65d4e3439c25 None admin] RBAC: Adding query filter params (role.id=897a5115997e4f9aa54ca31cde430c8f, scope.project.id=18b9124303d64d28bc970b0635e31a5a, user.id=c13c43069eaf41a4965adc8898135bb8) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:57.637822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42068b6-54d9-428f-993b-65d4e3439c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:57.639256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42068b6-54d9-428f-993b-65d4e3439c25 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:57.645351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 68/141] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:13:57 2022] GET /identity/v3/role_assignments?user.id=c13c43069eaf41a4965adc8898135bb8&scope.project.id=18b9124303d64d28bc970b0635e31a5a&role.id=897a5115997e4f9aa54ca31cde430c8f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:58.428679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5efd-9a42-4665-9f4f-b5572a358195 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:58.429332 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5efd-9a42-4665-9f4f-b5572a358195 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:58.429332 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5efd-9a42-4665-9f4f-b5572a358195 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:58.430726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 74/142] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:58.435937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770eb13-1abb-4168-b8d0-f648c1b92669 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:58.436342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770eb13-1abb-4168-b8d0-f648c1b92669 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:58.436506 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770eb13-1abb-4168-b8d0-f648c1b92669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:58.454993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6770eb13-1abb-4168-b8d0-f648c1b92669 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:58.456171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6770eb13-1abb-4168-b8d0-f648c1b92669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:58.525048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 69/143] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:58.626433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245643-4861-4493-8913-ed3176f49af0 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:58.626776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245643-4861-4493-8913-ed3176f49af0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:58.626985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245643-4861-4493-8913-ed3176f49af0 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:58.628448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 75/144] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:58.633499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc627f26-82fd-407e-b19b-e7b00e3d295f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:58.633778 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc627f26-82fd-407e-b19b-e7b00e3d295f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:58.634058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc627f26-82fd-407e-b19b-e7b00e3d295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:58.652392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-dc627f26-82fd-407e-b19b-e7b00e3d295f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:58.653570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dc627f26-82fd-407e-b19b-e7b00e3d295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:58.707709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06b183-2676-46ca-8d48-e84875c20008 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:58.707888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06b183-2676-46ca-8d48-e84875c20008 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:58.708163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06b183-2676-46ca-8d48-e84875c20008 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:58.709510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 76/145] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:13:58.715371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5f6e-4ebb-405a-8a56-6ea5e2183976 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:58.715652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5f6e-4ebb-405a-8a56-6ea5e2183976 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:58.715921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5f6e-4ebb-405a-8a56-6ea5e2183976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:58.719573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:58.729054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 70/146] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:13:58.735689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f96e5f6e-4ebb-405a-8a56-6ea5e2183976 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:13:58.736961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f96e5f6e-4ebb-405a-8a56-6ea5e2183976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:13:58.796928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc627f26-82fd-407e-b19b-e7b00e3d295f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:58.805638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 77/147] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:13:58.902484 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc627f26-82fd-407e-b19b-e7b00e3d295f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:58.939182 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568839e4-a74b-40b1-86e4-5532a56c420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:58.939812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568839e4-a74b-40b1-86e4-5532a56c420a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:58.940086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568839e4-a74b-40b1-86e4-5532a56c420a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:58.940356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568839e4-a74b-40b1-86e4-5532a56c420a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:58.951499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568839e4-a74b-40b1-86e4-5532a56c420a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-568839e4-a74b-40b1-86e4-5532a56c420a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:58.956471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:58.957389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:58.958238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 71/148] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:13:58.966389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e5f6e-4ebb-405a-8a56-6ea5e2183976 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:58.986184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:59.008576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568839e4-a74b-40b1-86e4-5532a56c420a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:59.071507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:59.077289 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e5f6e-4ebb-405a-8a56-6ea5e2183976 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:59.111508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da9d98-7fe1-4bb7-b13e-cdde9544032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:59.112107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da9d98-7fe1-4bb7-b13e-cdde9544032a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:59.112381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da9d98-7fe1-4bb7-b13e-cdde9544032a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:59.112648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da9d98-7fe1-4bb7-b13e-cdde9544032a None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:59.112956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568839e4-a74b-40b1-86e4-5532a56c420a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:59.113333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da9d98-7fe1-4bb7-b13e-cdde9544032a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:59.113631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da9d98-7fe1-4bb7-b13e-cdde9544032a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:59.115009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da9d98-7fe1-4bb7-b13e-cdde9544032a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:59.123172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 78/149] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:59.123800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da9d98-7fe1-4bb7-b13e-cdde9544032a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:59.148036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c94d7-532c-435a-a740-ea4fcbfbac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:59.148874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c94d7-532c-435a-a740-ea4fcbfbac9a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:59.149181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c94d7-532c-435a-a740-ea4fcbfbac9a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:59.149458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c94d7-532c-435a-a740-ea4fcbfbac9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:59.159502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c94d7-532c-435a-a740-ea4fcbfbac9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-0b5c94d7-532c-435a-a740-ea4fcbfbac9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:13:59.165097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:13:59.166139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:13:59.166916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 72/150] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:13:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:13:59.167651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c94d7-532c-435a-a740-ea4fcbfbac9a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:59.206552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:59.228468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da9d98-7fe1-4bb7-b13e-cdde9544032a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:59.261928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32498b05-bdf5-4ec5-9f3c-2619f0f77de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:59.262772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32498b05-bdf5-4ec5-9f3c-2619f0f77de7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:59.263044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32498b05-bdf5-4ec5-9f3c-2619f0f77de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:59.263309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32498b05-bdf5-4ec5-9f3c-2619f0f77de7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:59.264389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32498b05-bdf5-4ec5-9f3c-2619f0f77de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:59.265848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32498b05-bdf5-4ec5-9f3c-2619f0f77de7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:59.267395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 79/151] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:13:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:59.271888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32498b05-bdf5-4ec5-9f3c-2619f0f77de7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:59.271997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c94d7-532c-435a-a740-ea4fcbfbac9a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:59.293435 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:59.308332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2012c87-8521-4301-99ea-810bb5b94a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:59.308969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2012c87-8521-4301-99ea-810bb5b94a73 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:59.309297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2012c87-8521-4301-99ea-810bb5b94a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:59.309572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2012c87-8521-4301-99ea-810bb5b94a73 None admin] PATH_INFO: `/v3/users/0ba55d868a25484586cfb39c7b83c3b8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:59.323117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2012c87-8521-4301-99ea-810bb5b94a73 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba55d868a25484586cfb39c7b83c3b8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:59.324583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2012c87-8521-4301-99ea-810bb5b94a73 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:59.326221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 73/152] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:59 2022] GET /identity/v3/users/0ba55d868a25484586cfb39c7b83c3b8 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:59.326961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2012c87-8521-4301-99ea-810bb5b94a73 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:59.370142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32498b05-bdf5-4ec5-9f3c-2619f0f77de7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:59.403656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d8285-7702-4157-82cf-aa1ebc5b9dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:59.404257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d8285-7702-4157-82cf-aa1ebc5b9dec None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:59.404535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d8285-7702-4157-82cf-aa1ebc5b9dec None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:59.404807 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d8285-7702-4157-82cf-aa1ebc5b9dec None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:59.405493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d8285-7702-4157-82cf-aa1ebc5b9dec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:13:59.405794 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d8285-7702-4157-82cf-aa1ebc5b9dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:59.407156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d8285-7702-4157-82cf-aa1ebc5b9dec None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:59.416151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 80/153] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:13:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:59.416742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d8285-7702-4157-82cf-aa1ebc5b9dec None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:59.428557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:59.429170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2012c87-8521-4301-99ea-810bb5b94a73 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:59.462847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3a1d7-dd19-4ada-8a12-04a24a2aee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:59.463484 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3a1d7-dd19-4ada-8a12-04a24a2aee86 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:59.463706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3a1d7-dd19-4ada-8a12-04a24a2aee86 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:59.463974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3a1d7-dd19-4ada-8a12-04a24a2aee86 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:59.464618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3a1d7-dd19-4ada-8a12-04a24a2aee86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:59.466348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3a1d7-dd19-4ada-8a12-04a24a2aee86 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:59.488285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 74/154] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:13:59 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:13:59.488848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3a1d7-dd19-4ada-8a12-04a24a2aee86 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:59.523368 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d8285-7702-4157-82cf-aa1ebc5b9dec None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:59.552569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:59.566787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3bb9b-ae15-4fb0-be4c-5ba50315b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:59.567440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3bb9b-ae15-4fb0-be4c-5ba50315b592 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:59.567717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3bb9b-ae15-4fb0-be4c-5ba50315b592 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:59.567989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3bb9b-ae15-4fb0-be4c-5ba50315b592 None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:59.569269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3bb9b-ae15-4fb0-be4c-5ba50315b592 None admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:59.570868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3bb9b-ae15-4fb0-be4c-5ba50315b592 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:59.573419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 81/155] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:59 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:59.579161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3bb9b-ae15-4fb0-be4c-5ba50315b592 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:59.633038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3a1d7-dd19-4ada-8a12-04a24a2aee86 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:59.670797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:59.672893 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfc15e-b8e5-49d7-b2df-649981626b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:59.673587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfc15e-b8e5-49d7-b2df-649981626b70 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:59.674639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfc15e-b8e5-49d7-b2df-649981626b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:59.674966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfc15e-b8e5-49d7-b2df-649981626b70 None admin] PATH_INFO: `/v3/users/0ba55d868a25484586cfb39c7b83c3b8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:59.676063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfc15e-b8e5-49d7-b2df-649981626b70 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba55d868a25484586cfb39c7b83c3b8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:59.677558 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfc15e-b8e5-49d7-b2df-649981626b70 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:59.679741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 75/156] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:13:59 2022] GET /identity/v3/users/0ba55d868a25484586cfb39c7b83c3b8 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:59.685732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfc15e-b8e5-49d7-b2df-649981626b70 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:13:59.698369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3bb9b-ae15-4fb0-be4c-5ba50315b592 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:59.738371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299dc5-a07c-46e9-abc7-9abdfb35778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:59.738952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299dc5-a07c-46e9-abc7-9abdfb35778f None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:59.739230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299dc5-a07c-46e9-abc7-9abdfb35778f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:59.739498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299dc5-a07c-46e9-abc7-9abdfb35778f None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/users/0ba55d868a25484586cfb39c7b83c3b8/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:59.741540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f299dc5-a07c-46e9-abc7-9abdfb35778f None admin] RBAC: Authorizing `identity:create_grant(project_id=ab1231a1a5e54c6caf3fec16f606856a, user_id=0ba55d868a25484586cfb39c7b83c3b8, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:59.743056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f299dc5-a07c-46e9-abc7-9abdfb35778f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:59.759818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 82/157] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:13:59 2022] PUT /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/users/0ba55d868a25484586cfb39c7b83c3b8/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:13:59.822517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfc15e-b8e5-49d7-b2df-649981626b70 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:13:59.825001 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:13:59.871116 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afcbf4-2a56-41d7-a43f-c733227758e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:13:59.871872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afcbf4-2a56-41d7-a43f-c733227758e7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:13:59.872151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afcbf4-2a56-41d7-a43f-c733227758e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:13:59.872420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afcbf4-2a56-41d7-a43f-c733227758e7 None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:13:59.873654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afcbf4-2a56-41d7-a43f-c733227758e7 None admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:13:59.876142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afcbf4-2a56-41d7-a43f-c733227758e7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:13:59.879675 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 76/158] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:13:59 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:13:59.886848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299dc5-a07c-46e9-abc7-9abdfb35778f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:00.012487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299dc5-a07c-46e9-abc7-9abdfb35778f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:00.049326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b7e82-6507-49a7-a120-d9e51e3c281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:00.050405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b7e82-6507-49a7-a120-d9e51e3c281f None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:00.050898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b7e82-6507-49a7-a120-d9e51e3c281f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:00.051408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b7e82-6507-49a7-a120-d9e51e3c281f None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/users/0ba55d868a25484586cfb39c7b83c3b8/roles/2ba82c8be98e49f3a4e424556cab4bd3` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:00.054500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b7e82-6507-49a7-a120-d9e51e3c281f None admin] RBAC: Authorizing `identity:create_grant(project_id=ab1231a1a5e54c6caf3fec16f606856a, user_id=0ba55d868a25484586cfb39c7b83c3b8, role_id=2ba82c8be98e49f3a4e424556cab4bd3)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:00.056259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b7e82-6507-49a7-a120-d9e51e3c281f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:00.067301 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:00.073214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 83/159] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:13:59 2022] PUT /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/users/0ba55d868a25484586cfb39c7b83c3b8/roles/2ba82c8be98e49f3a4e424556cab4bd3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:14:01.868626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdda9b-bd43-42f7-9476-3b4ce77e441c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:01.869169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdda9b-bd43-42f7-9476-3b4ce77e441c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:01.869169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdda9b-bd43-42f7-9476-3b4ce77e441c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:01.870761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 77/160] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:01.876319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196c846-0366-44fb-b576-32581f3a1481 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:01.876726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196c846-0366-44fb-b576-32581f3a1481 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:01.876894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196c846-0366-44fb-b576-32581f3a1481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:01.887043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9776718-1dfe-4249-9551-19646ac2abf8 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:01.887326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9776718-1dfe-4249-9551-19646ac2abf8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:01.887599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9776718-1dfe-4249-9551-19646ac2abf8 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:01.888925 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 78/161] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:14:01.894912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e068-d16f-49d5-92f5-faab9680d6ff None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:01.895244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e068-d16f-49d5-92f5-faab9680d6ff None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:01.895524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e068-d16f-49d5-92f5-faab9680d6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:01.902401 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c196c846-0366-44fb-b576-32581f3a1481 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:01.903619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c196c846-0366-44fb-b576-32581f3a1481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:01.921201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a326e068-d16f-49d5-92f5-faab9680d6ff None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:01.922900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a326e068-d16f-49d5-92f5-faab9680d6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:01.981466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 84/162] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:02.004896 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 79/163] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:02.060043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddbd1a-ad2e-4581-85ad-6f9f9ed5c90f None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.060356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddbd1a-ad2e-4581-85ad-6f9f9ed5c90f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.060605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddbd1a-ad2e-4581-85ad-6f9f9ed5c90f None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.062006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 85/164] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:02.067196 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a490e-1cfb-43b2-a068-599f5a589f39 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.067484 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a490e-1cfb-43b2-a068-599f5a589f39 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.067760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a490e-1cfb-43b2-a068-599f5a589f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.087068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2c7a490e-1cfb-43b2-a068-599f5a589f39 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:02.088254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2c7a490e-1cfb-43b2-a068-599f5a589f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:02.167181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 80/165] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:02.235708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65293-4e73-4544-8176-249c83741acc None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.235988 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65293-4e73-4544-8176-249c83741acc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.236256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65293-4e73-4544-8176-249c83741acc None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.237796 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 86/166] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:02.243184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e5b9-f233-4ef8-9e2e-81acb4c715af None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.243468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e5b9-f233-4ef8-9e2e-81acb4c715af None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.243806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e5b9-f233-4ef8-9e2e-81acb4c715af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.262554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-66c4e5b9-f233-4ef8-9e2e-81acb4c715af None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:02.263864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-66c4e5b9-f233-4ef8-9e2e-81acb4c715af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:02.264929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f65293-4e73-4544-8176-249c83741acc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:02.291189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:02.342027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 81/167] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:02.343166 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e5b9-f233-4ef8-9e2e-81acb4c715af None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:02.398437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f65293-4e73-4544-8176-249c83741acc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:02.437113 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:02.444612 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c996a30-0eae-46be-80de-ea21e3e3ca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:02.445583 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996a30-0eae-46be-80de-ea21e3e3ca3f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.445583 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996a30-0eae-46be-80de-ea21e3e3ca3f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.445872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996a30-0eae-46be-80de-ea21e3e3ca3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.458384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c996a30-0eae-46be-80de-ea21e3e3ca3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:02.464295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e5b9-f233-4ef8-9e2e-81acb4c715af None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-7c996a30-0eae-46be-80de-ea21e3e3ca3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:02.464426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:02.465619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:02.466380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 87/168] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:02.467029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c996a30-0eae-46be-80de-ea21e3e3ca3f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:02.506262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0ab87-5d54-42f3-ad5e-0adaba7d547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:02.507823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0ab87-5d54-42f3-ad5e-0adaba7d547c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.508279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0ab87-5d54-42f3-ad5e-0adaba7d547c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.508730 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0ab87-5d54-42f3-ad5e-0adaba7d547c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.510360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0ab87-5d54-42f3-ad5e-0adaba7d547c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:02.512896 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0ab87-5d54-42f3-ad5e-0adaba7d547c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:02.516000 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 82/169] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:02.517140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0ab87-5d54-42f3-ad5e-0adaba7d547c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:02.552486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:02.591849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c996a30-0eae-46be-80de-ea21e3e3ca3f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:02.628938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1b0e0-5087-41f6-8006-bfde53e56040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:02.629602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1b0e0-5087-41f6-8006-bfde53e56040 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.629879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1b0e0-5087-41f6-8006-bfde53e56040 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.630146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1b0e0-5087-41f6-8006-bfde53e56040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.630397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0ab87-5d54-42f3-ad5e-0adaba7d547c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:02.640837 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1b0e0-5087-41f6-8006-bfde53e56040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-a3d1b0e0-5087-41f6-8006-bfde53e56040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:02.645733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:02.646687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 88/170] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:14:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:02.650190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1b0e0-5087-41f6-8006-bfde53e56040 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:02.668607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75994-7d19-4286-ba55-c759b6308a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:02.669245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75994-7d19-4286-ba55-c759b6308a61 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.669518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75994-7d19-4286-ba55-c759b6308a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.669783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75994-7d19-4286-ba55-c759b6308a61 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.670434 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b75994-7d19-4286-ba55-c759b6308a61 None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:02.670729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b75994-7d19-4286-ba55-c759b6308a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:02.672097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b75994-7d19-4286-ba55-c759b6308a61 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:02.680177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 83/171] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:02.680967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75994-7d19-4286-ba55-c759b6308a61 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:02.699060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:02.750369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1b0e0-5087-41f6-8006-bfde53e56040 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:02.770365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:02.780228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75994-7d19-4286-ba55-c759b6308a61 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:02.783465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0612-d5d4-472d-a671-63ce9114a022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:02.784067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0612-d5d4-472d-a671-63ce9114a022 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.784344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0612-d5d4-472d-a671-63ce9114a022 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.784615 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0612-d5d4-472d-a671-63ce9114a022 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.785290 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd0612-d5d4-472d-a671-63ce9114a022 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:02.786728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd0612-d5d4-472d-a671-63ce9114a022 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:02.807943 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 89/172] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:14:02 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:02.808601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0612-d5d4-472d-a671-63ce9114a022 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:02.816817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a680c2-3a34-4c47-b121-1d25dd304100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:02.817516 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a680c2-3a34-4c47-b121-1d25dd304100 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.817810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a680c2-3a34-4c47-b121-1d25dd304100 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.818067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a680c2-3a34-4c47-b121-1d25dd304100 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.831156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a680c2-3a34-4c47-b121-1d25dd304100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d0a680c2-3a34-4c47-b121-1d25dd304100 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:02.837518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:02.838490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:02.839261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 84/173] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:14:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:02.839906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a680c2-3a34-4c47-b121-1d25dd304100 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:02.941921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0612-d5d4-472d-a671-63ce9114a022 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:02.946672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:02.958881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a680c2-3a34-4c47-b121-1d25dd304100 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:02.983331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed435f2-c779-431a-96b5-de394440542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:02.984371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed435f2-c779-431a-96b5-de394440542e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:02.984371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed435f2-c779-431a-96b5-de394440542e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:02.984541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed435f2-c779-431a-96b5-de394440542e None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:02.985382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed435f2-c779-431a-96b5-de394440542e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:02.985382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed435f2-c779-431a-96b5-de394440542e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:02.986759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed435f2-c779-431a-96b5-de394440542e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:02.995388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 90/174] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:02.996021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed435f2-c779-431a-96b5-de394440542e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:03.002489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631e2df-0d35-4117-b0d8-3ca2a98c2634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:03.003136 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631e2df-0d35-4117-b0d8-3ca2a98c2634 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:03.003407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631e2df-0d35-4117-b0d8-3ca2a98c2634 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:03.003679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631e2df-0d35-4117-b0d8-3ca2a98c2634 None admin] PATH_INFO: `/v3/users/e458a679c792408fb93b8d5ee43de45e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:03.021489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631e2df-0d35-4117-b0d8-3ca2a98c2634 None admin] RBAC: Authorizing `identity:get_user(user_id=e458a679c792408fb93b8d5ee43de45e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:03.023778 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631e2df-0d35-4117-b0d8-3ca2a98c2634 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:03.025650 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 85/175] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:02 2022] GET /identity/v3/users/e458a679c792408fb93b8d5ee43de45e => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:03.026338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631e2df-0d35-4117-b0d8-3ca2a98c2634 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:03.038910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:03.121921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed435f2-c779-431a-96b5-de394440542e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:03.146405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631e2df-0d35-4117-b0d8-3ca2a98c2634 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:03.167713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917102-933c-44ed-ab39-a357c69bbb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:03.167713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917102-933c-44ed-ab39-a357c69bbb95 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:03.167713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917102-933c-44ed-ab39-a357c69bbb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:03.168088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68917102-933c-44ed-ab39-a357c69bbb95 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:03.168506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68917102-933c-44ed-ab39-a357c69bbb95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:03.168806 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68917102-933c-44ed-ab39-a357c69bbb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:03.171193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68917102-933c-44ed-ab39-a357c69bbb95 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:03.180842 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 91/176] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:03.182269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917102-933c-44ed-ab39-a357c69bbb95 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:03.193345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14858f-e69e-4dfd-b74d-06c94c718e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:03.193991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14858f-e69e-4dfd-b74d-06c94c718e53 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:03.194547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14858f-e69e-4dfd-b74d-06c94c718e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:03.194547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14858f-e69e-4dfd-b74d-06c94c718e53 None admin] PATH_INFO: `/v3/users/0ba55d868a25484586cfb39c7b83c3b8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:03.195770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14858f-e69e-4dfd-b74d-06c94c718e53 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba55d868a25484586cfb39c7b83c3b8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:03.197989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14858f-e69e-4dfd-b74d-06c94c718e53 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:03.199889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 86/177] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:03 2022] GET /identity/v3/users/0ba55d868a25484586cfb39c7b83c3b8 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:03.200727 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14858f-e69e-4dfd-b74d-06c94c718e53 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:03.218760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:03.296939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68917102-933c-44ed-ab39-a357c69bbb95 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:03.302011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:03.331993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14858f-e69e-4dfd-b74d-06c94c718e53 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:03.332977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc4cc5-9df0-4436-b726-4c8607247315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:03.333729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc4cc5-9df0-4436-b726-4c8607247315 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:03.334012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc4cc5-9df0-4436-b726-4c8607247315 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:03.334283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc4cc5-9df0-4436-b726-4c8607247315 None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:03.336009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc4cc5-9df0-4436-b726-4c8607247315 None admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:03.337586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc4cc5-9df0-4436-b726-4c8607247315 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:03.339248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 92/178] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:03 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:03.340360 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc4cc5-9df0-4436-b726-4c8607247315 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:03.376799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d5bab-cccc-4af5-8a5a-69534dd9aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:03.377467 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d5bab-cccc-4af5-8a5a-69534dd9aa7a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:03.377737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d5bab-cccc-4af5-8a5a-69534dd9aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:03.378003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d5bab-cccc-4af5-8a5a-69534dd9aa7a None admin] PATH_INFO: `/v3/users/0ba55d868a25484586cfb39c7b83c3b8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:03.379212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d5bab-cccc-4af5-8a5a-69534dd9aa7a None admin] RBAC: Authorizing `identity:get_user(user_id=0ba55d868a25484586cfb39c7b83c3b8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:03.380720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d5bab-cccc-4af5-8a5a-69534dd9aa7a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:03.388833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 87/179] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:03 2022] GET /identity/v3/users/0ba55d868a25484586cfb39c7b83c3b8 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:03.390009 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d5bab-cccc-4af5-8a5a-69534dd9aa7a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:03.455295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:03.462912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc4cc5-9df0-4436-b726-4c8607247315 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:03.504005 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7316a-246c-4a65-9755-068dc38245bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:03.504642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7316a-246c-4a65-9755-068dc38245bf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:03.504991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7316a-246c-4a65-9755-068dc38245bf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:03.505373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7316a-246c-4a65-9755-068dc38245bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:03.521205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d5bab-cccc-4af5-8a5a-69534dd9aa7a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:03.566406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9288-70d4-4689-9d8b-67cf6f6085f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:03.567065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9288-70d4-4689-9d8b-67cf6f6085f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:03.567492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9288-70d4-4689-9d8b-67cf6f6085f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:03.567765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9288-70d4-4689-9d8b-67cf6f6085f3 None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/users/e458a679c792408fb93b8d5ee43de45e/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:03.571022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a9288-70d4-4689-9d8b-67cf6f6085f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab1231a1a5e54c6caf3fec16f606856a, user_id=e458a679c792408fb93b8d5ee43de45e, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:03.573077 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a9288-70d4-4689-9d8b-67cf6f6085f3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:03.581683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7316a-246c-4a65-9755-068dc38245bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:03.583410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7316a-246c-4a65-9755-068dc38245bf None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:03.589853 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 88/180] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:14:03 2022] PUT /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/users/e458a679c792408fb93b8d5ee43de45e/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:03.590937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9288-70d4-4689-9d8b-67cf6f6085f3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:03.595198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:03.708528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:03.713314 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9288-70d4-4689-9d8b-67cf6f6085f3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:03.718032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 93/181] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:14:03.724290 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7316a-246c-4a65-9755-068dc38245bf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:03.754301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8f0ed-d9c7-4d93-83a6-fbd43e524b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:03.755422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8f0ed-d9c7-4d93-83a6-fbd43e524b37 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:03.756041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8f0ed-d9c7-4d93-83a6-fbd43e524b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:03.756380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8f0ed-d9c7-4d93-83a6-fbd43e524b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:03.862168 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7316a-246c-4a65-9755-068dc38245bf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:03.867494 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8f0ed-d9c7-4d93-83a6-fbd43e524b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:03.871486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8f0ed-d9c7-4d93-83a6-fbd43e524b37 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:03.880509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:03.919739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c847535-c122-43b9-b3f6-3cd4430b75db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:03.920372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c847535-c122-43b9-b3f6-3cd4430b75db None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:03.920643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c847535-c122-43b9-b3f6-3cd4430b75db None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:03.920909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c847535-c122-43b9-b3f6-3cd4430b75db None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:03.922159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c847535-c122-43b9-b3f6-3cd4430b75db None admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:03.923864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c847535-c122-43b9-b3f6-3cd4430b75db None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:03.925712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 94/182] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:03 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:03.931780 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c847535-c122-43b9-b3f6-3cd4430b75db None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:04.012347 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 89/183] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:14:04.017949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8f0ed-d9c7-4d93-83a6-fbd43e524b37 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:04.022975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:04.123375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c847535-c122-43b9-b3f6-3cd4430b75db None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:04.136822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8f0ed-d9c7-4d93-83a6-fbd43e524b37 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:04.149380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:04.176141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027671f7-371e-4322-92c6-c940e023f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:04.177090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027671f7-371e-4322-92c6-c940e023f3fe None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:04.177565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027671f7-371e-4322-92c6-c940e023f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:04.177975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027671f7-371e-4322-92c6-c940e023f3fe None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:04.179334 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027671f7-371e-4322-92c6-c940e023f3fe None admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:04.181490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027671f7-371e-4322-92c6-c940e023f3fe None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:04.183311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 90/184] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:04 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:04.188975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027671f7-371e-4322-92c6-c940e023f3fe None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:04.217390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d853338-750e-4ad1-8029-e4307210837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:04.220816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853338-750e-4ad1-8029-e4307210837c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:04.221287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853338-750e-4ad1-8029-e4307210837c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:04.221718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853338-750e-4ad1-8029-e4307210837c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:04.222649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d853338-750e-4ad1-8029-e4307210837c None admin] RBAC: Adding query filter params (role.id=6a01757540e64fed9041997458bd64e5, scope.project.id=ab1231a1a5e54c6caf3fec16f606856a, user.id=0ba55d868a25484586cfb39c7b83c3b8) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:04.223100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d853338-750e-4ad1-8029-e4307210837c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:04.225140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d853338-750e-4ad1-8029-e4307210837c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:04.232528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 95/185] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:14:03 2022] GET /identity/v3/role_assignments?user.id=0ba55d868a25484586cfb39c7b83c3b8&scope.project.id=ab1231a1a5e54c6caf3fec16f606856a&role.id=6a01757540e64fed9041997458bd64e5 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:04.363927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027671f7-371e-4322-92c6-c940e023f3fe None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:04.417004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e8298-f1e6-4bc0-abbf-7841708b8659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:04.417633 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8298-f1e6-4bc0-abbf-7841708b8659 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:04.417903 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8298-f1e6-4bc0-abbf-7841708b8659 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:04.418169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8298-f1e6-4bc0-abbf-7841708b8659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:04.418890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e8298-f1e6-4bc0-abbf-7841708b8659 None admin] RBAC: Adding query filter params (role.id=2ba82c8be98e49f3a4e424556cab4bd3, scope.project.id=ab1231a1a5e54c6caf3fec16f606856a, user.id=0ba55d868a25484586cfb39c7b83c3b8) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:04.419190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e8298-f1e6-4bc0-abbf-7841708b8659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:04.420696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e8298-f1e6-4bc0-abbf-7841708b8659 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:04.427037 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 91/186] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:14:04 2022] GET /identity/v3/role_assignments?user.id=0ba55d868a25484586cfb39c7b83c3b8&scope.project.id=ab1231a1a5e54c6caf3fec16f606856a&role.id=2ba82c8be98e49f3a4e424556cab4bd3 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:05.246931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747ca5-55df-40da-8772-25bfc727ad00 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:05.247414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747ca5-55df-40da-8772-25bfc727ad00 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:05.247414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747ca5-55df-40da-8772-25bfc727ad00 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:05.248737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 96/187] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:05.254109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea4766-32d7-4e9a-b8f8-d8d2c45d1e40 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:05.254539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea4766-32d7-4e9a-b8f8-d8d2c45d1e40 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:05.254622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea4766-32d7-4e9a-b8f8-d8d2c45d1e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:05.273375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3cea4766-32d7-4e9a-b8f8-d8d2c45d1e40 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:05.274874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3cea4766-32d7-4e9a-b8f8-d8d2c45d1e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:05.304670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:05.345438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 92/188] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:05.462220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8b03a-9b6b-4b15-af4e-aad735c41179 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:05.462576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8b03a-9b6b-4b15-af4e-aad735c41179 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:05.462779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8b03a-9b6b-4b15-af4e-aad735c41179 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:05.464145 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 97/189] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:05.469694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacd413-7b74-4439-bff9-072c16ad031d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:05.469981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacd413-7b74-4439-bff9-072c16ad031d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:05.470253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacd413-7b74-4439-bff9-072c16ad031d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:05.489324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ccacd413-7b74-4439-bff9-072c16ad031d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:05.490490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ccacd413-7b74-4439-bff9-072c16ad031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:05.558768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 93/190] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:05.621980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8b03a-9b6b-4b15-af4e-aad735c41179 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:05.726336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8b03a-9b6b-4b15-af4e-aad735c41179 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:05.751945 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:05.761201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52676f-f08b-4cd5-8ad6-1cef4286acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:05.761825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52676f-f08b-4cd5-8ad6-1cef4286acdf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:05.762098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52676f-f08b-4cd5-8ad6-1cef4286acdf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:05.762364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52676f-f08b-4cd5-8ad6-1cef4286acdf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:05.773511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52676f-f08b-4cd5-8ad6-1cef4286acdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-6d52676f-f08b-4cd5-8ad6-1cef4286acdf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:05.778479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:05.779352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:14:05.780118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:05.784267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 98/191] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:05.785508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacd413-7b74-4439-bff9-072c16ad031d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:05.831985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52676f-f08b-4cd5-8ad6-1cef4286acdf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:05.884590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:05.892414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacd413-7b74-4439-bff9-072c16ad031d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:05.940764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b01850-74e4-42bc-b428-ce9cf8ef6a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:05.941404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b01850-74e4-42bc-b428-ce9cf8ef6a58 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:05.941675 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b01850-74e4-42bc-b428-ce9cf8ef6a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:05.941899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52676f-f08b-4cd5-8ad6-1cef4286acdf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:05.942000 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b01850-74e4-42bc-b428-ce9cf8ef6a58 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:05.942584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b01850-74e4-42bc-b428-ce9cf8ef6a58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:05.942882 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b01850-74e4-42bc-b428-ce9cf8ef6a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:05.945422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b01850-74e4-42bc-b428-ce9cf8ef6a58 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:05.957387 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 94/192] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:05.959587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b01850-74e4-42bc-b428-ce9cf8ef6a58 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:05.978522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a276df3-7c70-4b13-b1ac-9bea4e9f0730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:05.979144 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a276df3-7c70-4b13-b1ac-9bea4e9f0730 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:05.979419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a276df3-7c70-4b13-b1ac-9bea4e9f0730 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:05.979691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a276df3-7c70-4b13-b1ac-9bea4e9f0730 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:05.980782 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a276df3-7c70-4b13-b1ac-9bea4e9f0730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:05.982248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a276df3-7c70-4b13-b1ac-9bea4e9f0730 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:05.983818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 99/193] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:05.989496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a276df3-7c70-4b13-b1ac-9bea4e9f0730 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:06.055889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:06.071970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b01850-74e4-42bc-b428-ce9cf8ef6a58 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:06.106823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a276df3-7c70-4b13-b1ac-9bea4e9f0730 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:06.109047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f5d56-a292-4f52-9b48-8b9b8a1f8c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:06.109876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5d56-a292-4f52-9b48-8b9b8a1f8c80 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:06.109986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5d56-a292-4f52-9b48-8b9b8a1f8c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:06.110195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5d56-a292-4f52-9b48-8b9b8a1f8c80 None admin] PATH_INFO: `/v3/users/cf9abff1fc4546c3b3a34f2744840006` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:06.123831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f5d56-a292-4f52-9b48-8b9b8a1f8c80 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9abff1fc4546c3b3a34f2744840006)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:06.125321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f5d56-a292-4f52-9b48-8b9b8a1f8c80 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:06.126968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 95/194] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:05 2022] GET /identity/v3/users/cf9abff1fc4546c3b3a34f2744840006 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:06.128116 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccb7fc-ee0d-4eab-aecc-6a48d922fdb1 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:06.128395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccb7fc-ee0d-4eab-aecc-6a48d922fdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:06.128664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccb7fc-ee0d-4eab-aecc-6a48d922fdb1 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:06.129879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 96/195] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:06.132213 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccb7fc-ee0d-4eab-aecc-6a48d922fdb1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:06.146578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7ed94-d2cd-4ced-897f-64ebd71c3f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:06.147187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7ed94-d2cd-4ced-897f-64ebd71c3f47 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:06.147987 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7ed94-d2cd-4ced-897f-64ebd71c3f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:06.148871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7ed94-d2cd-4ced-897f-64ebd71c3f47 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:06.149560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7ed94-d2cd-4ced-897f-64ebd71c3f47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:06.150293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:06.151154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7ed94-d2cd-4ced-897f-64ebd71c3f47 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:06.173363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 100/196] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:14:05 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:14:06.174576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a6e76-01f1-498b-b299-9801eaa4f115 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:06.174856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a6e76-01f1-498b-b299-9801eaa4f115 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:06.175125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a6e76-01f1-498b-b299-9801eaa4f115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:06.195816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7c8a6e76-01f1-498b-b299-9801eaa4f115 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:06.197123 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7c8a6e76-01f1-498b-b299-9801eaa4f115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:06.252096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccb7fc-ee0d-4eab-aecc-6a48d922fdb1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:06.272012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 101/197] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:06.293678 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5f62f-240b-4ae4-ac06-7b84c33e8329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:06.294961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5f62f-240b-4ae4-ac06-7b84c33e8329 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:06.295411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5f62f-240b-4ae4-ac06-7b84c33e8329 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:06.295888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5f62f-240b-4ae4-ac06-7b84c33e8329 None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:06.297263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5f62f-240b-4ae4-ac06-7b84c33e8329 None admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:06.299011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5f62f-240b-4ae4-ac06-7b84c33e8329 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:06.301249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 97/198] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:06 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:06.308069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a6e76-01f1-498b-b299-9801eaa4f115 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:06.357627 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:06.419517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a6e76-01f1-498b-b299-9801eaa4f115 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:06.457370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2967109-8e0d-4f30-abc1-18ca7bd8d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:06.458070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2967109-8e0d-4f30-abc1-18ca7bd8d59a None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:06.458308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2967109-8e0d-4f30-abc1-18ca7bd8d59a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:06.458582 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2967109-8e0d-4f30-abc1-18ca7bd8d59a None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/users/cf9abff1fc4546c3b3a34f2744840006/roles/897a5115997e4f9aa54ca31cde430c8f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:06.460750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2967109-8e0d-4f30-abc1-18ca7bd8d59a None admin] RBAC: Authorizing `identity:create_grant(project_id=ab1231a1a5e54c6caf3fec16f606856a, user_id=cf9abff1fc4546c3b3a34f2744840006, role_id=897a5115997e4f9aa54ca31cde430c8f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:06.462229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2967109-8e0d-4f30-abc1-18ca7bd8d59a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:06.478145 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 102/199] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:14:06 2022] PUT /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/users/cf9abff1fc4546c3b3a34f2744840006/roles/897a5115997e4f9aa54ca31cde430c8f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:14:06.547623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5f62f-240b-4ae4-ac06-7b84c33e8329 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:06.655698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:06.677444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5f62f-240b-4ae4-ac06-7b84c33e8329 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:06.727815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10705cd8-43b4-4eb1-8ccb-af9e6a0a6571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:06.727815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10705cd8-43b4-4eb1-8ccb-af9e6a0a6571 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:06.728074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10705cd8-43b4-4eb1-8ccb-af9e6a0a6571 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:06.728317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10705cd8-43b4-4eb1-8ccb-af9e6a0a6571 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:06.744244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10705cd8-43b4-4eb1-8ccb-af9e6a0a6571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-10705cd8-43b4-4eb1-8ccb-af9e6a0a6571 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:06.749405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:06.750296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:06.751059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:06.751642 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 98/200] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:06.758005 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2967109-8e0d-4f30-abc1-18ca7bd8d59a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:06.965931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2967109-8e0d-4f30-abc1-18ca7bd8d59a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:06.968951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:07.014361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e1784-a4f3-4c8c-9aae-6fc93d49dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:07.014990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1784-a4f3-4c8c-9aae-6fc93d49dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:07.015263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1784-a4f3-4c8c-9aae-6fc93d49dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:07.015533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e1784-a4f3-4c8c-9aae-6fc93d49dcd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:07.016197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e1784-a4f3-4c8c-9aae-6fc93d49dcd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:07.016497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e1784-a4f3-4c8c-9aae-6fc93d49dcd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:07.018172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e1784-a4f3-4c8c-9aae-6fc93d49dcd7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:07.033848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 103/201] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:07.041058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10705cd8-43b4-4eb1-8ccb-af9e6a0a6571 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:07.227954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10705cd8-43b4-4eb1-8ccb-af9e6a0a6571 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:07.267787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628db66-7227-4ff1-90ab-af905f46ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:07.268428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628db66-7227-4ff1-90ab-af905f46ef2e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:07.268702 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628db66-7227-4ff1-90ab-af905f46ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:07.268974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628db66-7227-4ff1-90ab-af905f46ef2e None admin] PATH_INFO: `/v3/users/e458a679c792408fb93b8d5ee43de45e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:07.270139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628db66-7227-4ff1-90ab-af905f46ef2e None admin] RBAC: Authorizing `identity:get_user(user_id=e458a679c792408fb93b8d5ee43de45e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:07.271599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628db66-7227-4ff1-90ab-af905f46ef2e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:07.274182 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 99/202] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:07 2022] GET /identity/v3/users/e458a679c792408fb93b8d5ee43de45e => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:07.279538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e1784-a4f3-4c8c-9aae-6fc93d49dcd7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:07.389346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e1784-a4f3-4c8c-9aae-6fc93d49dcd7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:07.424636 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc214f-68d8-4f3d-9975-8366654c52a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:07.425281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc214f-68d8-4f3d-9975-8366654c52a1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:07.425558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc214f-68d8-4f3d-9975-8366654c52a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:07.425827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc214f-68d8-4f3d-9975-8366654c52a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:07.457886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:07.496263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc214f-68d8-4f3d-9975-8366654c52a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:07.497727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc214f-68d8-4f3d-9975-8366654c52a1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:07.604194 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 104/203] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:14:07.610068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628db66-7227-4ff1-90ab-af905f46ef2e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:07.626115 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:07.722781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628db66-7227-4ff1-90ab-af905f46ef2e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:07.764136 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d6cf8-9a8a-49da-be72-8548e30f8f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:07.764706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6cf8-9a8a-49da-be72-8548e30f8f4c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:07.764983 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6cf8-9a8a-49da-be72-8548e30f8f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:07.765288 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6cf8-9a8a-49da-be72-8548e30f8f4c None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:07.766428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6cf8-9a8a-49da-be72-8548e30f8f4c None admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:07.767889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6cf8-9a8a-49da-be72-8548e30f8f4c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:07.769854 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 100/204] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:07 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:07.775981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc214f-68d8-4f3d-9975-8366654c52a1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:07.841394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:07.881470 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc214f-68d8-4f3d-9975-8366654c52a1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:07.917792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66f8a-6723-4094-b2f3-3bb7a3ef0318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:07.918400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66f8a-6723-4094-b2f3-3bb7a3ef0318 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:07.918674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66f8a-6723-4094-b2f3-3bb7a3ef0318 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:07.918945 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66f8a-6723-4094-b2f3-3bb7a3ef0318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:07.919664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66f8a-6723-4094-b2f3-3bb7a3ef0318 None admin] RBAC: Adding query filter params (role.id=30142fe6cc4944d988168c210fc8c902, scope.project.id=ab1231a1a5e54c6caf3fec16f606856a, user.id=e458a679c792408fb93b8d5ee43de45e) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:07.919966 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66f8a-6723-4094-b2f3-3bb7a3ef0318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:07.921503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66f8a-6723-4094-b2f3-3bb7a3ef0318 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:07.928062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 105/205] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:14:07 2022] GET /identity/v3/role_assignments?user.id=e458a679c792408fb93b8d5ee43de45e&scope.project.id=ab1231a1a5e54c6caf3fec16f606856a&role.id=30142fe6cc4944d988168c210fc8c902 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:08.683209 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded341b4-de82-4465-a53f-4183ff1f135c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:08.683926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded341b4-de82-4465-a53f-4183ff1f135c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:08.683926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded341b4-de82-4465-a53f-4183ff1f135c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:08.685248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 101/206] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:08.690793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bdbc2-f124-48db-a339-7f733ff23487 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:08.691402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bdbc2-f124-48db-a339-7f733ff23487 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:08.691402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bdbc2-f124-48db-a339-7f733ff23487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:08.713238 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-707bdbc2-f124-48db-a339-7f733ff23487 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:08.714475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-707bdbc2-f124-48db-a339-7f733ff23487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:08.717294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377a656-6dc0-4a33-9f1e-f1527bcd6c1c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:08.717575 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377a656-6dc0-4a33-9f1e-f1527bcd6c1c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:08.717852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377a656-6dc0-4a33-9f1e-f1527bcd6c1c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:08.719204 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 102/207] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:08.725745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d785-2bb9-4e36-8c5a-5e5e2c03ebf6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:08.726100 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d785-2bb9-4e36-8c5a-5e5e2c03ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:08.726760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d785-2bb9-4e36-8c5a-5e5e2c03ebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:08.744846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-efb2d785-2bb9-4e36-8c5a-5e5e2c03ebf6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:08.746032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-efb2d785-2bb9-4e36-8c5a-5e5e2c03ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:08.793279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 106/208] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:08.817721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaffc0f-0103-447f-9ce9-d6b5eb9c629e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:08.818003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaffc0f-0103-447f-9ce9-d6b5eb9c629e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:08.818276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaffc0f-0103-447f-9ce9-d6b5eb9c629e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:08.820197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 107/209] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:14:08.823218 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 103/210] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:08.825270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17127d-1a5c-437e-b93c-9c8d5b5493bf None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:08.825549 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17127d-1a5c-437e-b93c-9c8d5b5493bf None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:08.825816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17127d-1a5c-437e-b93c-9c8d5b5493bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:08.844597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4c17127d-1a5c-437e-b93c-9c8d5b5493bf None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:08.845785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4c17127d-1a5c-437e-b93c-9c8d5b5493bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:08.899157 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:08.918620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 108/211] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:09.068295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2d785-2bb9-4e36-8c5a-5e5e2c03ebf6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:09.081314 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:09.089726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17127d-1a5c-437e-b93c-9c8d5b5493bf None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:09.170912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2d785-2bb9-4e36-8c5a-5e5e2c03ebf6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:09.196303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17127d-1a5c-437e-b93c-9c8d5b5493bf None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:09.205095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf866f-6105-4cbd-bd70-1a842d5e5772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:09.205718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf866f-6105-4cbd-bd70-1a842d5e5772 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:09.205988 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf866f-6105-4cbd-bd70-1a842d5e5772 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:09.206253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf866f-6105-4cbd-bd70-1a842d5e5772 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:09.216849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf866f-6105-4cbd-bd70-1a842d5e5772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-4ebf866f-6105-4cbd-bd70-1a842d5e5772 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:09.221622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:09.222607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 104/212] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:09.223559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf866f-6105-4cbd-bd70-1a842d5e5772 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:09.233497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecadd78-1363-4f73-9442-b6c585a82dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:09.234137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecadd78-1363-4f73-9442-b6c585a82dcb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:09.234407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecadd78-1363-4f73-9442-b6c585a82dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:09.234673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecadd78-1363-4f73-9442-b6c585a82dcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:09.235767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecadd78-1363-4f73-9442-b6c585a82dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:09.237235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecadd78-1363-4f73-9442-b6c585a82dcb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:09.241047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 109/213] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:09.241047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecadd78-1363-4f73-9442-b6c585a82dcb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:09.293871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:09.296414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:09.324026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf866f-6105-4cbd-bd70-1a842d5e5772 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:09.340684 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecadd78-1363-4f73-9442-b6c585a82dcb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:09.358657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79db94b-b56e-47a0-9599-75241697cf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:09.359277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79db94b-b56e-47a0-9599-75241697cf67 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:09.359548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79db94b-b56e-47a0-9599-75241697cf67 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:09.359813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79db94b-b56e-47a0-9599-75241697cf67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:09.370155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79db94b-b56e-47a0-9599-75241697cf67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-a79db94b-b56e-47a0-9599-75241697cf67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:09.375121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:09.376143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:14:09.376917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:09.377539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c829b47-6014-4684-af82-1b1f46ae6449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:09.377539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c829b47-6014-4684-af82-1b1f46ae6449 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:09.377539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c829b47-6014-4684-af82-1b1f46ae6449 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:09.377735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 105/214] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:09.377808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c829b47-6014-4684-af82-1b1f46ae6449 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:09.377808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c829b47-6014-4684-af82-1b1f46ae6449 None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:09.377934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79db94b-b56e-47a0-9599-75241697cf67 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:09.378000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c829b47-6014-4684-af82-1b1f46ae6449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:09.378678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c829b47-6014-4684-af82-1b1f46ae6449 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:09.387965 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 110/215] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:09.388760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c829b47-6014-4684-af82-1b1f46ae6449 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:09.478778 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79db94b-b56e-47a0-9599-75241697cf67 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:09.490424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c829b47-6014-4684-af82-1b1f46ae6449 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:09.506581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:09.506784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:09.513566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609defd-ff68-4888-9c9e-222ad10a6a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:09.514170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609defd-ff68-4888-9c9e-222ad10a6a80 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:09.514448 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609defd-ff68-4888-9c9e-222ad10a6a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:09.514714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609defd-ff68-4888-9c9e-222ad10a6a80 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:09.515358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609defd-ff68-4888-9c9e-222ad10a6a80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:09.516811 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609defd-ff68-4888-9c9e-222ad10a6a80 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:09.524515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd2a3b-ec98-4907-9fcc-9b93edf795c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:09.525140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd2a3b-ec98-4907-9fcc-9b93edf795c1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:09.525414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd2a3b-ec98-4907-9fcc-9b93edf795c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:09.525679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd2a3b-ec98-4907-9fcc-9b93edf795c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:09.526326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd2a3b-ec98-4907-9fcc-9b93edf795c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:09.526621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd2a3b-ec98-4907-9fcc-9b93edf795c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:09.527960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd2a3b-ec98-4907-9fcc-9b93edf795c1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:09.539413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 111/216] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:09.541415 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 106/217] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:14:09 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:09.542099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd2a3b-ec98-4907-9fcc-9b93edf795c1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:09.545330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609defd-ff68-4888-9c9e-222ad10a6a80 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:09.663118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd2a3b-ec98-4907-9fcc-9b93edf795c1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:09.669605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609defd-ff68-4888-9c9e-222ad10a6a80 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:09.703589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce616e5-18ba-4b6a-9a31-6ef19b569148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:09.704235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce616e5-18ba-4b6a-9a31-6ef19b569148 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:09.704505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce616e5-18ba-4b6a-9a31-6ef19b569148 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:09.704775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce616e5-18ba-4b6a-9a31-6ef19b569148 None admin] PATH_INFO: `/v3/users/311e631720ca4d10ba03a9abe9cda1e9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:09.706428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0915df-eb13-4917-8d17-656b773ffd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:09.707185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0915df-eb13-4917-8d17-656b773ffd50 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:09.707459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0915df-eb13-4917-8d17-656b773ffd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:09.707764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0915df-eb13-4917-8d17-656b773ffd50 None admin] PATH_INFO: `/v3/users/cf9abff1fc4546c3b3a34f2744840006` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:09.708900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0915df-eb13-4917-8d17-656b773ffd50 None admin] RBAC: Authorizing `identity:get_user(user_id=cf9abff1fc4546c3b3a34f2744840006)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:09.710730 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0915df-eb13-4917-8d17-656b773ffd50 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:09.712496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 107/218] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:09 2022] GET /identity/v3/users/cf9abff1fc4546c3b3a34f2744840006 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:09.718488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0915df-eb13-4917-8d17-656b773ffd50 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:09.720442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce616e5-18ba-4b6a-9a31-6ef19b569148 None admin] RBAC: Authorizing `identity:get_user(user_id=311e631720ca4d10ba03a9abe9cda1e9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:09.721933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce616e5-18ba-4b6a-9a31-6ef19b569148 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:09.723960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 112/219] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:09 2022] GET /identity/v3/users/311e631720ca4d10ba03a9abe9cda1e9 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:09.730281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce616e5-18ba-4b6a-9a31-6ef19b569148 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:09.776047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:09.789150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:09.849426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0915df-eb13-4917-8d17-656b773ffd50 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:09.850229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce616e5-18ba-4b6a-9a31-6ef19b569148 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:09.895249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3704145-11f6-4ab7-9e1f-c04c23b1a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:09.895862 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3704145-11f6-4ab7-9e1f-c04c23b1a24e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:09.896135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3704145-11f6-4ab7-9e1f-c04c23b1a24e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:09.896323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013de46-0f65-4129-a955-09c112d905c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:09.896432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3704145-11f6-4ab7-9e1f-c04c23b1a24e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:09.896941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013de46-0f65-4129-a955-09c112d905c2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:09.897201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013de46-0f65-4129-a955-09c112d905c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:09.898055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013de46-0f65-4129-a955-09c112d905c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:09.898757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013de46-0f65-4129-a955-09c112d905c2 None admin] RBAC: Adding query filter params (role.id=30142fe6cc4944d988168c210fc8c902, user.id=311e631720ca4d10ba03a9abe9cda1e9, scope.system=all) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:09.899028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013de46-0f65-4129-a955-09c112d905c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:09.902435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013de46-0f65-4129-a955-09c112d905c2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:09.909683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 113/220] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Nov 2 07:14:09 2022] GET /identity/v3/role_assignments?user.id=311e631720ca4d10ba03a9abe9cda1e9&scope.system=all&role.id=30142fe6cc4944d988168c210fc8c902 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:09.998044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3704145-11f6-4ab7-9e1f-c04c23b1a24e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:09.999472 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3704145-11f6-4ab7-9e1f-c04c23b1a24e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:10.069255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:10.122673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 108/221] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:14:10.128307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013de46-0f65-4129-a955-09c112d905c2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:10.242120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013de46-0f65-4129-a955-09c112d905c2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:10.243772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:10.281055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb55aa-fd3d-407f-b2bf-f241f27762ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:10.281909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb55aa-fd3d-407f-b2bf-f241f27762ed None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:10.282328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb55aa-fd3d-407f-b2bf-f241f27762ed None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:10.282738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb55aa-fd3d-407f-b2bf-f241f27762ed None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:10.284038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb55aa-fd3d-407f-b2bf-f241f27762ed None admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:10.285645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb55aa-fd3d-407f-b2bf-f241f27762ed None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:10.287496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 114/222] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:10 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:10.294894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3704145-11f6-4ab7-9e1f-c04c23b1a24e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:10.403855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3704145-11f6-4ab7-9e1f-c04c23b1a24e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:10.439645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b00f5-63a9-446d-bbbe-c20dfbea05d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:10.440253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b00f5-63a9-446d-bbbe-c20dfbea05d7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:10.440528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b00f5-63a9-446d-bbbe-c20dfbea05d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:10.440795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b00f5-63a9-446d-bbbe-c20dfbea05d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:10.441553 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b00f5-63a9-446d-bbbe-c20dfbea05d7 None admin] RBAC: Adding query filter params (role.id=897a5115997e4f9aa54ca31cde430c8f, scope.project.id=ab1231a1a5e54c6caf3fec16f606856a, user.id=cf9abff1fc4546c3b3a34f2744840006) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:10.441859 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b00f5-63a9-446d-bbbe-c20dfbea05d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:10.443287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b00f5-63a9-446d-bbbe-c20dfbea05d7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:10.449834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 109/223] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:14:10 2022] GET /identity/v3/role_assignments?user.id=cf9abff1fc4546c3b3a34f2744840006&scope.project.id=ab1231a1a5e54c6caf3fec16f606856a&role.id=897a5115997e4f9aa54ca31cde430c8f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:11.852387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714caa41-2b52-46f8-9710-ee153715dab1 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:11.852938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714caa41-2b52-46f8-9710-ee153715dab1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:11.852938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714caa41-2b52-46f8-9710-ee153715dab1 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:11.854316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 115/224] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:11.859440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ba50a-c30c-4c64-b635-b02fb8c3fb92 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:11.859846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ba50a-c30c-4c64-b635-b02fb8c3fb92 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:11.860062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ba50a-c30c-4c64-b635-b02fb8c3fb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:11.879118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6d7ba50a-c30c-4c64-b635-b02fb8c3fb92 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:11.880305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6d7ba50a-c30c-4c64-b635-b02fb8c3fb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:11.895043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:11.959132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 110/225] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:12.028000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935f11a-eba0-48b6-b26b-ac8ac3cfe451 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.028276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935f11a-eba0-48b6-b26b-ac8ac3cfe451 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.028709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935f11a-eba0-48b6-b26b-ac8ac3cfe451 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.030266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 116/226] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:12.035637 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e735-1e05-4789-a7da-fc462dafb609 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.035922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e735-1e05-4789-a7da-fc462dafb609 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.036193 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e735-1e05-4789-a7da-fc462dafb609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.054686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f421e735-1e05-4789-a7da-fc462dafb609 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:12.055851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f421e735-1e05-4789-a7da-fc462dafb609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:12.102920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7346c-0410-4d01-9a8b-ab57053f6790 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.103125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7346c-0410-4d01-9a8b-ab57053f6790 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.103395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7346c-0410-4d01-9a8b-ab57053f6790 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.104880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 117/227] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:14:12.109734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a3602-4153-416d-b9f0-76b58c3e0bbf None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.110011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a3602-4153-416d-b9f0-76b58c3e0bbf None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.110480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a3602-4153-416d-b9f0-76b58c3e0bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.124122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 111/228] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:12.128321 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-937a3602-4153-416d-b9f0-76b58c3e0bbf None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:12.129717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-937a3602-4153-416d-b9f0-76b58c3e0bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:12.195444 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 118/229] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:12.243957 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e735-1e05-4789-a7da-fc462dafb609 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:12.323523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:12.346353 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e735-1e05-4789-a7da-fc462dafb609 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:12.379203 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defcc01-18bd-4c85-b564-a7c083f4ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:12.379758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defcc01-18bd-4c85-b564-a7c083f4ed68 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.380027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defcc01-18bd-4c85-b564-a7c083f4ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.380294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defcc01-18bd-4c85-b564-a7c083f4ed68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.390802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a3602-4153-416d-b9f0-76b58c3e0bbf None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:12.391837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defcc01-18bd-4c85-b564-a7c083f4ed68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5defcc01-18bd-4c85-b564-a7c083f4ed68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:12.398507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:12.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:12.404920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 112/230] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:12.406482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defcc01-18bd-4c85-b564-a7c083f4ed68 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:12.495588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:12.499266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a3602-4153-416d-b9f0-76b58c3e0bbf None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:12.508259 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defcc01-18bd-4c85-b564-a7c083f4ed68 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:12.533384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129cc53-6aa0-478a-bac6-3c70c8fbe620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:12.534121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129cc53-6aa0-478a-bac6-3c70c8fbe620 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.534475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129cc53-6aa0-478a-bac6-3c70c8fbe620 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.534862 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129cc53-6aa0-478a-bac6-3c70c8fbe620 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.536304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129cc53-6aa0-478a-bac6-3c70c8fbe620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:12.538491 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129cc53-6aa0-478a-bac6-3c70c8fbe620 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:12.540754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 119/231] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:12.542090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129cc53-6aa0-478a-bac6-3c70c8fbe620 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:12.548400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b773ef-5802-44ab-9e29-a02654ddbf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:12.549188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b773ef-5802-44ab-9e29-a02654ddbf51 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.549597 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b773ef-5802-44ab-9e29-a02654ddbf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.549989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b773ef-5802-44ab-9e29-a02654ddbf51 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.550814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b773ef-5802-44ab-9e29-a02654ddbf51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:12.551175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b773ef-5802-44ab-9e29-a02654ddbf51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:12.552844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b773ef-5802-44ab-9e29-a02654ddbf51 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:12.559487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:12.563695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 113/232] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:12.564419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b773ef-5802-44ab-9e29-a02654ddbf51 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:12.645443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129cc53-6aa0-478a-bac6-3c70c8fbe620 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:12.667468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b773ef-5802-44ab-9e29-a02654ddbf51 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:12.681165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b66550-a3f7-4fa4-b566-f422e72e58fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:12.681872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b66550-a3f7-4fa4-b566-f422e72e58fd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.682147 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b66550-a3f7-4fa4-b566-f422e72e58fd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.682416 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b66550-a3f7-4fa4-b566-f422e72e58fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.692333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b66550-a3f7-4fa4-b566-f422e72e58fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-23b66550-a3f7-4fa4-b566-f422e72e58fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:12.697664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:12.698700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 120/233] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:12.701844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b66550-a3f7-4fa4-b566-f422e72e58fd None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:12.702536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75167881-31ae-4438-bba5-c7465b1f7d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:12.702536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75167881-31ae-4438-bba5-c7465b1f7d9e None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.702536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75167881-31ae-4438-bba5-c7465b1f7d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.702536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75167881-31ae-4438-bba5-c7465b1f7d9e None admin] PATH_INFO: `/v3/groups` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.702950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75167881-31ae-4438-bba5-c7465b1f7d9e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:12.704411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75167881-31ae-4438-bba5-c7465b1f7d9e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:12.720271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 114/234] 10.222.0.13 () {60 vars in 1134 bytes} [Wed Nov 2 07:14:12 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:12.721087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75167881-31ae-4438-bba5-c7465b1f7d9e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:12.740162 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:12.802299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:12.827690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b66550-a3f7-4fa4-b566-f422e72e58fd None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:12.850579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75167881-31ae-4438-bba5-c7465b1f7d9e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:12.872888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c52e1-400d-4c08-a93b-bd2e048bcb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:12.874203 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c52e1-400d-4c08-a93b-bd2e048bcb8d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.874628 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c52e1-400d-4c08-a93b-bd2e048bcb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.875056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c52e1-400d-4c08-a93b-bd2e048bcb8d None admin] PATH_INFO: `/v3/users/66ef7ff23f634c0a930cf84890d52d4a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.888743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11d806-690b-4dff-99b8-edc33b1a6dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:12.889388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11d806-690b-4dff-99b8-edc33b1a6dda None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:12.889664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11d806-690b-4dff-99b8-edc33b1a6dda None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:12.889931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11d806-690b-4dff-99b8-edc33b1a6dda None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:12.890597 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11d806-690b-4dff-99b8-edc33b1a6dda None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:12.890890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11d806-690b-4dff-99b8-edc33b1a6dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:12.892270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11d806-690b-4dff-99b8-edc33b1a6dda None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:12.894614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c52e1-400d-4c08-a93b-bd2e048bcb8d None admin] RBAC: Authorizing `identity:get_user(user_id=66ef7ff23f634c0a930cf84890d52d4a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:12.896395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c52e1-400d-4c08-a93b-bd2e048bcb8d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:12.899485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 121/235] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:12 2022] GET /identity/v3/users/66ef7ff23f634c0a930cf84890d52d4a => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:12.903849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 115/236] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:12.908356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c52e1-400d-4c08-a93b-bd2e048bcb8d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:12.910801 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11d806-690b-4dff-99b8-edc33b1a6dda None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:13.006670 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:13.022021 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11d806-690b-4dff-99b8-edc33b1a6dda None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:13.024381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c52e1-400d-4c08-a93b-bd2e048bcb8d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:13.046523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:13.060027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0df61f-35ec-4d14-a542-fe92f0fa08dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:13.060662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0df61f-35ec-4d14-a542-fe92f0fa08dd None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:13.060937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0df61f-35ec-4d14-a542-fe92f0fa08dd None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:13.061240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0df61f-35ec-4d14-a542-fe92f0fa08dd None admin] PATH_INFO: `/v3/users/311e631720ca4d10ba03a9abe9cda1e9` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:13.062348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c3b6e-1645-4971-9c5d-d0cdda10f37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:13.062489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0df61f-35ec-4d14-a542-fe92f0fa08dd None admin] RBAC: Authorizing `identity:get_user(user_id=311e631720ca4d10ba03a9abe9cda1e9)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:13.062956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c3b6e-1645-4971-9c5d-d0cdda10f37c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:13.063232 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c3b6e-1645-4971-9c5d-d0cdda10f37c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:13.063505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c3b6e-1645-4971-9c5d-d0cdda10f37c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:13.063826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0df61f-35ec-4d14-a542-fe92f0fa08dd None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:13.064224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c3b6e-1645-4971-9c5d-d0cdda10f37c None admin] RBAC: Adding query filter params (role.id=897a5115997e4f9aa54ca31cde430c8f, user.id=66ef7ff23f634c0a930cf84890d52d4a, scope.system=all) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:13.064532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c3b6e-1645-4971-9c5d-d0cdda10f37c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:13.070645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 116/237] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:12 2022] GET /identity/v3/users/311e631720ca4d10ba03a9abe9cda1e9 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:13.070773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c3b6e-1645-4971-9c5d-d0cdda10f37c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:13.071425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0df61f-35ec-4d14-a542-fe92f0fa08dd None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:13.074778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 122/238] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Nov 2 07:14:12 2022] GET /identity/v3/role_assignments?user.id=66ef7ff23f634c0a930cf84890d52d4a&scope.system=all&role.id=897a5115997e4f9aa54ca31cde430c8f => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:13.183568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0df61f-35ec-4d14-a542-fe92f0fa08dd None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:13.220719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f9e56-1cab-4337-be8a-ea69a0f61f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:13.221423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f9e56-1cab-4337-be8a-ea69a0f61f95 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:13.221700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f9e56-1cab-4337-be8a-ea69a0f61f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:13.221968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f9e56-1cab-4337-be8a-ea69a0f61f95 None admin] PATH_INFO: `/v3/system/users/311e631720ca4d10ba03a9abe9cda1e9/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:13.223438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f9e56-1cab-4337-be8a-ea69a0f61f95 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=311e631720ca4d10ba03a9abe9cda1e9, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:13.224843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f9e56-1cab-4337-be8a-ea69a0f61f95 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:13.243693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 117/239] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Nov 2 07:14:13 2022] PUT /identity/v3/system/users/311e631720ca4d10ba03a9abe9cda1e9/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:14:15.010353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09e728-83d5-4f03-8568-3582757483f9 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.010857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09e728-83d5-4f03-8568-3582757483f9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.010931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09e728-83d5-4f03-8568-3582757483f9 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.012405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 123/240] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:15.017485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe8510-e761-4e38-98a0-d006d49c79e9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.017864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe8510-e761-4e38-98a0-d006d49c79e9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.018039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe8510-e761-4e38-98a0-d006d49c79e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.036766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-aabe8510-e761-4e38-98a0-d006d49c79e9 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:15.037985 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aabe8510-e761-4e38-98a0-d006d49c79e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:15.093223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:15.113939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 118/241] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:15.224435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718baf4-9022-4494-ae1e-c6c3649fb7ad None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.224718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718baf4-9022-4494-ae1e-c6c3649fb7ad None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.224905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718baf4-9022-4494-ae1e-c6c3649fb7ad None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.226501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 124/242] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:15.231445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26992d78-5ca8-401a-9e0c-db8b1b565f03 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.231726 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26992d78-5ca8-401a-9e0c-db8b1b565f03 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.231998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26992d78-5ca8-401a-9e0c-db8b1b565f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.250533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-26992d78-5ca8-401a-9e0c-db8b1b565f03 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:15.251704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-26992d78-5ca8-401a-9e0c-db8b1b565f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:15.320524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 119/243] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:15.391474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718baf4-9022-4494-ae1e-c6c3649fb7ad None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:15.430347 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689473-8e90-4d16-9dec-9c3b89065024 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.430655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689473-8e90-4d16-9dec-9c3b89065024 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.430886 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01689473-8e90-4d16-9dec-9c3b89065024 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.432344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 120/244] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:14:15.437040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50e0ef-5d1b-48fe-8fac-d525d1c5ec6e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.437327 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50e0ef-5d1b-48fe-8fac-d525d1c5ec6e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.437621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50e0ef-5d1b-48fe-8fac-d525d1c5ec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.455411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7d50e0ef-5d1b-48fe-8fac-d525d1c5ec6e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:15.456580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7d50e0ef-5d1b-48fe-8fac-d525d1c5ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:15.496688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718baf4-9022-4494-ae1e-c6c3649fb7ad None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:15.523745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 121/245] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:15.536566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16376d-68ee-4b0f-885b-3d266a6cd6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:15.537295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16376d-68ee-4b0f-885b-3d266a6cd6bc None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.537622 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16376d-68ee-4b0f-885b-3d266a6cd6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.537936 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16376d-68ee-4b0f-885b-3d266a6cd6bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.539213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16376d-68ee-4b0f-885b-3d266a6cd6bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:15.540933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16376d-68ee-4b0f-885b-3d266a6cd6bc None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:15.542684 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 125/246] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:15.548133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50e0ef-5d1b-48fe-8fac-d525d1c5ec6e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:15.589388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16376d-68ee-4b0f-885b-3d266a6cd6bc None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:15.594378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:15.609343 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:15.654068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50e0ef-5d1b-48fe-8fac-d525d1c5ec6e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:15.692317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17979d9-9947-4bde-8e9f-f2cbb3596d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:15.692547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16376d-68ee-4b0f-885b-3d266a6cd6bc None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:15.692929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17979d9-9947-4bde-8e9f-f2cbb3596d56 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.693232 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17979d9-9947-4bde-8e9f-f2cbb3596d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.693503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17979d9-9947-4bde-8e9f-f2cbb3596d56 None admin] PATH_INFO: `/v3/groups` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.694916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17979d9-9947-4bde-8e9f-f2cbb3596d56 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:15.697344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17979d9-9947-4bde-8e9f-f2cbb3596d56 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:15.716281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 122/247] 10.222.0.13 () {60 vars in 1134 bytes} [Wed Nov 2 07:14:15 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:15.731050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac90fb-3d80-4ad7-9c86-3cfb5e2f7fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:15.731706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac90fb-3d80-4ad7-9c86-3cfb5e2f7fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.731981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac90fb-3d80-4ad7-9c86-3cfb5e2f7fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.732250 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac90fb-3d80-4ad7-9c86-3cfb5e2f7fd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.745080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac90fb-3d80-4ad7-9c86-3cfb5e2f7fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-4eac90fb-3d80-4ad7-9c86-3cfb5e2f7fd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:15.750213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:15.751128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:14:15.751920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:15.753283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 126/248] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:15.757341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17979d9-9947-4bde-8e9f-f2cbb3596d56 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:15.789800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac90fb-3d80-4ad7-9c86-3cfb5e2f7fd5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:15.875353 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17979d9-9947-4bde-8e9f-f2cbb3596d56 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:15.878611 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:15.881143 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:15.909247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac90fb-3d80-4ad7-9c86-3cfb5e2f7fd5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:15.922393 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800e3a6-35b0-482a-9082-205c323230a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:15.923008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800e3a6-35b0-482a-9082-205c323230a8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.923281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800e3a6-35b0-482a-9082-205c323230a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.923548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800e3a6-35b0-482a-9082-205c323230a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.924204 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800e3a6-35b0-482a-9082-205c323230a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:15.924500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800e3a6-35b0-482a-9082-205c323230a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:15.926982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800e3a6-35b0-482a-9082-205c323230a8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:15.938927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 123/249] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:15.945098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800e3a6-35b0-482a-9082-205c323230a8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:15.954582 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc949206-8312-479b-b803-257d4663e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:15.955214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc949206-8312-479b-b803-257d4663e4db None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:15.955489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc949206-8312-479b-b803-257d4663e4db None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:15.955757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc949206-8312-479b-b803-257d4663e4db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:15.968313 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc949206-8312-479b-b803-257d4663e4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-fc949206-8312-479b-b803-257d4663e4db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:15.973159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:15.974046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:15.975152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 127/250] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:15.980984 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc949206-8312-479b-b803-257d4663e4db None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:16.071450 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800e3a6-35b0-482a-9082-205c323230a8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:16.117113 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc949206-8312-479b-b803-257d4663e4db None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:16.117884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3f824-7e09-4c5d-a7d1-a7fe8780371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:16.118528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f824-7e09-4c5d-a7d1-a7fe8780371f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:16.118811 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f824-7e09-4c5d-a7d1-a7fe8780371f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:16.119191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3f824-7e09-4c5d-a7d1-a7fe8780371f None admin] PATH_INFO: `/v3/users/66ef7ff23f634c0a930cf84890d52d4a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:16.120349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3f824-7e09-4c5d-a7d1-a7fe8780371f None admin] RBAC: Authorizing `identity:get_user(user_id=66ef7ff23f634c0a930cf84890d52d4a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:16.121867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3f824-7e09-4c5d-a7d1-a7fe8780371f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:16.123590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 124/251] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:15 2022] GET /identity/v3/users/66ef7ff23f634c0a930cf84890d52d4a => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:16.129801 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3f824-7e09-4c5d-a7d1-a7fe8780371f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:16.164445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbd1e8-9dcc-4687-94ac-000b9d78f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:16.164675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd1e8-9dcc-4687-94ac-000b9d78f60e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:16.167800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd1e8-9dcc-4687-94ac-000b9d78f60e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:16.167800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd1e8-9dcc-4687-94ac-000b9d78f60e None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:16.167800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbd1e8-9dcc-4687-94ac-000b9d78f60e None admin] RBAC: Adding query filter params (name=member) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:16.167800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbd1e8-9dcc-4687-94ac-000b9d78f60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:16.168101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbd1e8-9dcc-4687-94ac-000b9d78f60e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:16.172733 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:16.175337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:16.179644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 128/252] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:16.185361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbd1e8-9dcc-4687-94ac-000b9d78f60e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:16.258548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3f824-7e09-4c5d-a7d1-a7fe8780371f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:16.303505 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a1b85-3e1d-43b0-9f64-4598c9b79b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:16.304916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a1b85-3e1d-43b0-9f64-4598c9b79b9c None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:16.305342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a1b85-3e1d-43b0-9f64-4598c9b79b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:16.305711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a1b85-3e1d-43b0-9f64-4598c9b79b9c None admin] PATH_INFO: `/v3/system/users/66ef7ff23f634c0a930cf84890d52d4a/roles/897a5115997e4f9aa54ca31cde430c8f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:16.307991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a1b85-3e1d-43b0-9f64-4598c9b79b9c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=66ef7ff23f634c0a930cf84890d52d4a, role_id=897a5115997e4f9aa54ca31cde430c8f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:16.309542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a1b85-3e1d-43b0-9f64-4598c9b79b9c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:16.310098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbd1e8-9dcc-4687-94ac-000b9d78f60e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:16.325489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 125/253] 10.222.0.13 () {58 vars in 1334 bytes} [Wed Nov 2 07:14:16 2022] PUT /identity/v3/system/users/66ef7ff23f634c0a930cf84890d52d4a/roles/897a5115997e4f9aa54ca31cde430c8f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:14:16.366185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0d764-6522-41a5-a1eb-77ff6621ac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:16.367034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d764-6522-41a5-a1eb-77ff6621ac59 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:16.367323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d764-6522-41a5-a1eb-77ff6621ac59 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:16.367593 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0d764-6522-41a5-a1eb-77ff6621ac59 None admin] PATH_INFO: `/v3/users/311e631720ca4d10ba03a9abe9cda1e9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:16.368977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0d764-6522-41a5-a1eb-77ff6621ac59 None admin] RBAC: Authorizing `identity:get_user(user_id=311e631720ca4d10ba03a9abe9cda1e9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:16.370652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0d764-6522-41a5-a1eb-77ff6621ac59 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:16.373562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 129/254] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:16 2022] GET /identity/v3/users/311e631720ca4d10ba03a9abe9cda1e9 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:16.379319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a1b85-3e1d-43b0-9f64-4598c9b79b9c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:16.516417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:16.523051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a1b85-3e1d-43b0-9f64-4598c9b79b9c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:16.565707 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19425c7-bc80-405f-9a6e-ce564398e54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:16.566321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19425c7-bc80-405f-9a6e-ce564398e54a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:16.566598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19425c7-bc80-405f-9a6e-ce564398e54a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:16.566866 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19425c7-bc80-405f-9a6e-ce564398e54a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:16.567594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19425c7-bc80-405f-9a6e-ce564398e54a None admin] RBAC: Adding query filter params (role.id=30142fe6cc4944d988168c210fc8c902, user.id=311e631720ca4d10ba03a9abe9cda1e9, scope.system=all) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:16.567896 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19425c7-bc80-405f-9a6e-ce564398e54a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:16.569389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19425c7-bc80-405f-9a6e-ce564398e54a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:16.583947 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 126/255] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Nov 2 07:14:16 2022] GET /identity/v3/role_assignments?user.id=311e631720ca4d10ba03a9abe9cda1e9&scope.system=all&role.id=30142fe6cc4944d988168c210fc8c902 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:18.167876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adca07-c3eb-4938-8dcc-6af55799ce3e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:18.168850 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adca07-c3eb-4938-8dcc-6af55799ce3e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:18.169379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adca07-c3eb-4938-8dcc-6af55799ce3e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:18.170935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 130/256] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:18.176484 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609302c5-e078-4e80-8357-597809119433 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:18.176904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609302c5-e078-4e80-8357-597809119433 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:18.177143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609302c5-e078-4e80-8357-597809119433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:18.206591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-609302c5-e078-4e80-8357-597809119433 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:18.207772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-609302c5-e078-4e80-8357-597809119433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:18.289457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 127/257] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:14:18.582523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adca07-c3eb-4938-8dcc-6af55799ce3e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:18.597026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adca07-c3eb-4938-8dcc-6af55799ce3e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:18.602728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867360-459b-4a5b-8c3d-edeb1f5dc57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:18.603590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867360-459b-4a5b-8c3d-edeb1f5dc57d admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:18.604086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867360-459b-4a5b-8c3d-edeb1f5dc57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:18.604557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867360-459b-4a5b-8c3d-edeb1f5dc57d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:18.619337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39867360-459b-4a5b-8c3d-edeb1f5dc57d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-39867360-459b-4a5b-8c3d-edeb1f5dc57d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:18.624568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:18.625449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:18.626235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:18.628564 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 131/258] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 07:14:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:18.635020 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609302c5-e078-4e80-8357-597809119433 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:18.644280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609302c5-e078-4e80-8357-597809119433 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:18.661703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7640e1-a994-4f7a-9fbe-1c73691cbe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:18.662337 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7640e1-a994-4f7a-9fbe-1c73691cbe85 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:18.662608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7640e1-a994-4f7a-9fbe-1c73691cbe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:18.662877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7640e1-a994-4f7a-9fbe-1c73691cbe85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:18.664082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7640e1-a994-4f7a-9fbe-1c73691cbe85 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:18.664381 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7640e1-a994-4f7a-9fbe-1c73691cbe85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:18.666214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-7f7640e1-a994-4f7a-9fbe-1c73691cbe85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:14:18.666214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: warnings.warn(msg) Nov 02 07:14:18.666214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: Nov 02 07:14:18.667130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7640e1-a994-4f7a-9fbe-1c73691cbe85 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:18.680279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 128/259] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:14:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:18.685822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867360-459b-4a5b-8c3d-edeb1f5dc57d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:18.698704 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867360-459b-4a5b-8c3d-edeb1f5dc57d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:18.706536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2c8fa-e1e8-46ce-b98f-6796da105fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:18.707433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2c8fa-e1e8-46ce-b98f-6796da105fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:18.707910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2c8fa-e1e8-46ce-b98f-6796da105fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:18.708403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2c8fa-e1e8-46ce-b98f-6796da105fd1 admin admin] PATH_INFO: `/v3/groups/6056068cc66548be8d69df88cca7a9de` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:18.718026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2c8fa-e1e8-46ce-b98f-6796da105fd1 admin admin] RBAC: Authorizing `identity:get_group(group_id=6056068cc66548be8d69df88cca7a9de)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:18.720086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-66f2c8fa-e1e8-46ce-b98f-6796da105fd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:14:18.720086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: warnings.warn(msg) Nov 02 07:14:18.720086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: Nov 02 07:14:18.721802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2c8fa-e1e8-46ce-b98f-6796da105fd1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:18.723758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 132/260] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 2 07:14:18 2022] GET /identity/v3/groups/6056068cc66548be8d69df88cca7a9de => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:18.730189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7640e1-a994-4f7a-9fbe-1c73691cbe85 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:18.746561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7640e1-a994-4f7a-9fbe-1c73691cbe85 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:18.753225 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94826ef7-54df-4871-9812-eef41a7e916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:18.753846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94826ef7-54df-4871-9812-eef41a7e916e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:18.754127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94826ef7-54df-4871-9812-eef41a7e916e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:18.754396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94826ef7-54df-4871-9812-eef41a7e916e admin admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:18.755520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94826ef7-54df-4871-9812-eef41a7e916e admin admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:18.757674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94826ef7-54df-4871-9812-eef41a7e916e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:18.759591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 129/261] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 07:14:18 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:18.764836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2c8fa-e1e8-46ce-b98f-6796da105fd1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:18.779981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2c8fa-e1e8-46ce-b98f-6796da105fd1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:18.786974 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8657dd-a942-4894-b180-ae975b1c90c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:18.787954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8657dd-a942-4894-b180-ae975b1c90c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:18.788569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8657dd-a942-4894-b180-ae975b1c90c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:18.789065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8657dd-a942-4894-b180-ae975b1c90c1 admin admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a/groups/6056068cc66548be8d69df88cca7a9de/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:18.791411 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8657dd-a942-4894-b180-ae975b1c90c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b9124303d64d28bc970b0635e31a5a, group_id=6056068cc66548be8d69df88cca7a9de, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:18.792712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-1a8657dd-a942-4894-b180-ae975b1c90c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:14:18.792712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: warnings.warn(msg) Nov 02 07:14:18.792712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: Nov 02 07:14:18.795227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8657dd-a942-4894-b180-ae975b1c90c1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:18.816791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 133/262] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 2 07:14:18 2022] PUT /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a/groups/6056068cc66548be8d69df88cca7a9de/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:19.269073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a33fd0-3cdd-4e95-8c17-2d5b29aa05f0 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.269555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a33fd0-3cdd-4e95-8c17-2d5b29aa05f0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.269555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a33fd0-3cdd-4e95-8c17-2d5b29aa05f0 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.271120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 130/263] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:19.276192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e3253-353e-429a-abd0-ba943141fa90 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.277076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e3253-353e-429a-abd0-ba943141fa90 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.277556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e3253-353e-429a-abd0-ba943141fa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.280793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba3de7-a650-4b86-a7f2-de9af5f97034 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.281102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba3de7-a650-4b86-a7f2-de9af5f97034 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.281376 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba3de7-a650-4b86-a7f2-de9af5f97034 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.282810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 131/264] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:19.297523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538a83e-6007-415c-b5a2-e50214206c16 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.297806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538a83e-6007-415c-b5a2-e50214206c16 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.298073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538a83e-6007-415c-b5a2-e50214206c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.302448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-de7e3253-353e-429a-abd0-ba943141fa90 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:19.303880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-de7e3253-353e-429a-abd0-ba943141fa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:19.330114 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5538a83e-6007-415c-b5a2-e50214206c16 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:19.331325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5538a83e-6007-415c-b5a2-e50214206c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:19.352217 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:19.377278 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 134/265] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:14:19.427405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 132/266] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 02 07:14:19.594599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df7343-1260-44e6-8ef8-1f61d1d30679 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.595165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df7343-1260-44e6-8ef8-1f61d1d30679 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.595634 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df7343-1260-44e6-8ef8-1f61d1d30679 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.597184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 135/267] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:19.602937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d155-3b61-4520-9a67-b2882d30b2bf None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.603489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d155-3b61-4520-9a67-b2882d30b2bf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.603933 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87d155-3b61-4520-9a67-b2882d30b2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.629338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-bc87d155-3b61-4520-9a67-b2882d30b2bf None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:19.630799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bc87d155-3b61-4520-9a67-b2882d30b2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:19.664188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:19.709370 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 133/268] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:19.824781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df7343-1260-44e6-8ef8-1f61d1d30679 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:19.838584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df7343-1260-44e6-8ef8-1f61d1d30679 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:19.849269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a639fc-481a-4770-851b-7ae015fb96dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:19.850192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a639fc-481a-4770-851b-7ae015fb96dd admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.850663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a639fc-481a-4770-851b-7ae015fb96dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.851217 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a639fc-481a-4770-851b-7ae015fb96dd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.864469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a639fc-481a-4770-851b-7ae015fb96dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-33a639fc-481a-4770-851b-7ae015fb96dd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:19.869750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:19.870595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:19.871421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:19.873074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87d155-3b61-4520-9a67-b2882d30b2bf None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:19.874191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 136/269] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 07:14:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:19.880304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a639fc-481a-4770-851b-7ae015fb96dd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:19.894028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87d155-3b61-4520-9a67-b2882d30b2bf None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:19.895184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a639fc-481a-4770-851b-7ae015fb96dd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:19.903043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21da357-320d-4bff-826f-e7feaa879456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:19.905044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b2d25-6e20-43fd-8eda-dade9e640a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:19.905354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21da357-320d-4bff-826f-e7feaa879456 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.905819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21da357-320d-4bff-826f-e7feaa879456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.906800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21da357-320d-4bff-826f-e7feaa879456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.907547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b2d25-6e20-43fd-8eda-dade9e640a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.908004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b2d25-6e20-43fd-8eda-dade9e640a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.908570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21da357-320d-4bff-826f-e7feaa879456 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:19.909310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21da357-320d-4bff-826f-e7feaa879456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:19.909618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b2d25-6e20-43fd-8eda-dade9e640a81 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.911336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-b21da357-320d-4bff-826f-e7feaa879456 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:14:19.911336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: warnings.warn(msg) Nov 02 07:14:19.911336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: Nov 02 07:14:19.912857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21da357-320d-4bff-826f-e7feaa879456 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:19.930453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 137/270] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 2 07:14:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:19.930635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b2d25-6e20-43fd-8eda-dade9e640a81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-393b2d25-6e20-43fd-8eda-dade9e640a81 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:19.935821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:19.936891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:19.937919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:19.938601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21da357-320d-4bff-826f-e7feaa879456 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:19.942437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 134/271] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 07:14:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:19.953255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b2d25-6e20-43fd-8eda-dade9e640a81 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:19.954447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21da357-320d-4bff-826f-e7feaa879456 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:19.959961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f5e9-56d4-4da4-a58a-f347247fbb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:19.960665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f5e9-56d4-4da4-a58a-f347247fbb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.960938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f5e9-56d4-4da4-a58a-f347247fbb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.961913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f5e9-56d4-4da4-a58a-f347247fbb59 admin admin] PATH_INFO: `/v3/groups/6056068cc66548be8d69df88cca7a9de` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.963346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1f5e9-56d4-4da4-a58a-f347247fbb59 admin admin] RBAC: Authorizing `identity:get_group(group_id=6056068cc66548be8d69df88cca7a9de)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:19.965482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1f5e9-56d4-4da4-a58a-f347247fbb59 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:19.966316 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b2d25-6e20-43fd-8eda-dade9e640a81 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:19.972444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516264-ed98-4d4b-a9bf-692de8244189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:19.973400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 138/272] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 2 07:14:19 2022] GET /identity/v3/groups/6056068cc66548be8d69df88cca7a9de => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:19.973577 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516264-ed98-4d4b-a9bf-692de8244189 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:19.973726 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516264-ed98-4d4b-a9bf-692de8244189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:19.974056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516264-ed98-4d4b-a9bf-692de8244189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:19.974830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97516264-ed98-4d4b-a9bf-692de8244189 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:19.975192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97516264-ed98-4d4b-a9bf-692de8244189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:19.977616 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97516264-ed98-4d4b-a9bf-692de8244189 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:19.979544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f5e9-56d4-4da4-a58a-f347247fbb59 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:19.989938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 135/273] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:14:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:19.996492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f5e9-56d4-4da4-a58a-f347247fbb59 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:20.000494 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516264-ed98-4d4b-a9bf-692de8244189 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:20.004367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727dca8-ed3a-4a48-b630-568d908b15e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:20.004998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727dca8-ed3a-4a48-b630-568d908b15e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:20.005368 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727dca8-ed3a-4a48-b630-568d908b15e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:20.005632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727dca8-ed3a-4a48-b630-568d908b15e6 admin admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:20.009728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727dca8-ed3a-4a48-b630-568d908b15e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:20.013069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727dca8-ed3a-4a48-b630-568d908b15e6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:20.018255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516264-ed98-4d4b-a9bf-692de8244189 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:20.019305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 139/274] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 07:14:19 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:20.021809 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727dca8-ed3a-4a48-b630-568d908b15e6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:20.029406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f57f7-cdaa-425f-8920-d34119762392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:20.030316 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f57f7-cdaa-425f-8920-d34119762392 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:20.030808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f57f7-cdaa-425f-8920-d34119762392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:20.031286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f57f7-cdaa-425f-8920-d34119762392 admin admin] PATH_INFO: `/v3/groups/6056068cc66548be8d69df88cca7a9de` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:20.033755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f57f7-cdaa-425f-8920-d34119762392 admin admin] RBAC: Authorizing `identity:get_group(group_id=6056068cc66548be8d69df88cca7a9de)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:20.034969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-d36f57f7-cdaa-425f-8920-d34119762392 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:14:20.034969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: warnings.warn(msg) Nov 02 07:14:20.034969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: Nov 02 07:14:20.041541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727dca8-ed3a-4a48-b630-568d908b15e6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:20.041935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f57f7-cdaa-425f-8920-d34119762392 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:20.049083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 136/275] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 2 07:14:19 2022] GET /identity/v3/groups/6056068cc66548be8d69df88cca7a9de => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:20.051453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f57f7-cdaa-425f-8920-d34119762392 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:20.059766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20cce4-9a3c-4349-b4d5-3c21a3758916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:20.060733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20cce4-9a3c-4349-b4d5-3c21a3758916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:20.061234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20cce4-9a3c-4349-b4d5-3c21a3758916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:20.061697 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20cce4-9a3c-4349-b4d5-3c21a3758916 admin admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a/groups/6056068cc66548be8d69df88cca7a9de/roles/2ba82c8be98e49f3a4e424556cab4bd3` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:20.065435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20cce4-9a3c-4349-b4d5-3c21a3758916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b9124303d64d28bc970b0635e31a5a, group_id=6056068cc66548be8d69df88cca7a9de, role_id=2ba82c8be98e49f3a4e424556cab4bd3)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:20.068311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20cce4-9a3c-4349-b4d5-3c21a3758916 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:20.071805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f57f7-cdaa-425f-8920-d34119762392 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:20.081046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86482fd2-e2b0-494a-9f16-dd6757c200d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:20.082059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86482fd2-e2b0-494a-9f16-dd6757c200d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:20.082528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86482fd2-e2b0-494a-9f16-dd6757c200d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:20.083008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86482fd2-e2b0-494a-9f16-dd6757c200d1 admin admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:20.084423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86482fd2-e2b0-494a-9f16-dd6757c200d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:20.093923 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 140/276] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 2 07:14:20 2022] PUT /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a/groups/6056068cc66548be8d69df88cca7a9de/roles/2ba82c8be98e49f3a4e424556cab4bd3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:20.094245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86482fd2-e2b0-494a-9f16-dd6757c200d1 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:20.096282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 137/277] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 07:14:20 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:20.102883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20cce4-9a3c-4349-b4d5-3c21a3758916 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:20.182355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20cce4-9a3c-4349-b4d5-3c21a3758916 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:20.187456 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b098c7e-d14e-4249-bae4-abf787657e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:20.188468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098c7e-d14e-4249-bae4-abf787657e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:20.189037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098c7e-d14e-4249-bae4-abf787657e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:20.189503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098c7e-d14e-4249-bae4-abf787657e1b admin admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/groups/6056068cc66548be8d69df88cca7a9de/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:20.192161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b098c7e-d14e-4249-bae4-abf787657e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1231a1a5e54c6caf3fec16f606856a, group_id=6056068cc66548be8d69df88cca7a9de, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:20.195661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b098c7e-d14e-4249-bae4-abf787657e1b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:20.218716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 141/278] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 2 07:14:20 2022] PUT /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/groups/6056068cc66548be8d69df88cca7a9de/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:20.283470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7d48f-31e1-4300-b3db-a00440f7aaf0 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:20.283976 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7d48f-31e1-4300-b3db-a00440f7aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:20.284048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7d48f-31e1-4300-b3db-a00440f7aaf0 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:20.285993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 138/279] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:20.286497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b098c7e-d14e-4249-bae4-abf787657e1b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:20.295765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5be05d-a6ee-4fb9-9223-989be87aeaf3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:20.296093 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5be05d-a6ee-4fb9-9223-989be87aeaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:20.296352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5be05d-a6ee-4fb9-9223-989be87aeaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:20.321425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8f5be05d-a6ee-4fb9-9223-989be87aeaf3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:20.324260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8f5be05d-a6ee-4fb9-9223-989be87aeaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:20.422806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 139/280] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 07:14:20.473301 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:20.503669 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b098c7e-d14e-4249-bae4-abf787657e1b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:20.551414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a637-a2f5-4289-ba86-9ff04d21f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:20.552054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a637-a2f5-4289-ba86-9ff04d21f965 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:20.552324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a637-a2f5-4289-ba86-9ff04d21f965 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:20.552589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a637-a2f5-4289-ba86-9ff04d21f965 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:20.565390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592a637-a2f5-4289-ba86-9ff04d21f965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d592a637-a2f5-4289-ba86-9ff04d21f965 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:20.572043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:20.572922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:20.573771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 142/281] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:20.581130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5be05d-a6ee-4fb9-9223-989be87aeaf3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:20.684530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:20.707052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5be05d-a6ee-4fb9-9223-989be87aeaf3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:20.744493 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b95e5-3910-478a-b7dd-6afc53fc66ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:20.745131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b95e5-3910-478a-b7dd-6afc53fc66ec None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:20.745414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b95e5-3910-478a-b7dd-6afc53fc66ec None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:20.745688 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b95e5-3910-478a-b7dd-6afc53fc66ec None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:20.746359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b95e5-3910-478a-b7dd-6afc53fc66ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:20.746658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b95e5-3910-478a-b7dd-6afc53fc66ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:20.748034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b95e5-3910-478a-b7dd-6afc53fc66ec None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:20.761762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 140/282] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:20.767367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a637-a2f5-4289-ba86-9ff04d21f965 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:20.893734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592a637-a2f5-4289-ba86-9ff04d21f965 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:20.940093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519c19f-6881-45e3-9404-332ffd08ecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:20.940637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519c19f-6881-45e3-9404-332ffd08ecc4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:20.940907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519c19f-6881-45e3-9404-332ffd08ecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:20.941204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519c19f-6881-45e3-9404-332ffd08ecc4 None admin] PATH_INFO: `/v3/users/66ef7ff23f634c0a930cf84890d52d4a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:20.944357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519c19f-6881-45e3-9404-332ffd08ecc4 None admin] RBAC: Authorizing `identity:get_user(user_id=66ef7ff23f634c0a930cf84890d52d4a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:20.946594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519c19f-6881-45e3-9404-332ffd08ecc4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:20.948506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 143/283] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:14:20 2022] GET /identity/v3/users/66ef7ff23f634c0a930cf84890d52d4a => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:20.954193 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b95e5-3910-478a-b7dd-6afc53fc66ec None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.037699 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519c19f-6881-45e3-9404-332ffd08ecc4 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.059679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519c19f-6881-45e3-9404-332ffd08ecc4 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.068753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbc914-3827-4110-afb9-79e1ccec02c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.069457 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc914-3827-4110-afb9-79e1ccec02c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.069841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc914-3827-4110-afb9-79e1ccec02c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.070108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc914-3827-4110-afb9-79e1ccec02c1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.078077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:21.097857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbc914-3827-4110-afb9-79e1ccec02c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:21.104260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b95e5-3910-478a-b7dd-6afc53fc66ec None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d9fbc914-3827-4110-afb9-79e1ccec02c1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:21.107003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:21.107888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:21.108688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 144/284] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 07:14:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:21.109517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ba96-a5c9-427a-b68b-b158b7761952 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.110024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ba96-a5c9-427a-b68b-b158b7761952 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.110024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ba96-a5c9-427a-b68b-b158b7761952 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.111160 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 145/285] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:21.121954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5ba96-a5c9-427a-b68b-b158b7761952 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.146062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f4c85-3bc9-42f5-8591-39f71a6671c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.147116 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f4c85-3bc9-42f5-8591-39f71a6671c1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.147645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f4c85-3bc9-42f5-8591-39f71a6671c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.148729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f4c85-3bc9-42f5-8591-39f71a6671c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.149832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f4c85-3bc9-42f5-8591-39f71a6671c1 None admin] RBAC: Adding query filter params (role.id=897a5115997e4f9aa54ca31cde430c8f, user.id=66ef7ff23f634c0a930cf84890d52d4a, scope.system=all) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:21.150335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f4c85-3bc9-42f5-8591-39f71a6671c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:21.152044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f4c85-3bc9-42f5-8591-39f71a6671c1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:21.153697 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5ba96-a5c9-427a-b68b-b158b7761952 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.165028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 141/286] 10.222.0.13 () {56 vars in 1308 bytes} [Wed Nov 2 07:14:20 2022] GET /identity/v3/role_assignments?user.id=66ef7ff23f634c0a930cf84890d52d4a&scope.system=all&role.id=897a5115997e4f9aa54ca31cde430c8f => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:21.165489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:21.168220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee9296-c94d-40ee-98ee-e6a1a69cd6c9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.168748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee9296-c94d-40ee-98ee-e6a1a69cd6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.169278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee9296-c94d-40ee-98ee-e6a1a69cd6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.177843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163aa68-e437-49ba-960f-63562e3011ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.178463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163aa68-e437-49ba-960f-63562e3011ca admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.178737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163aa68-e437-49ba-960f-63562e3011ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.179607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163aa68-e437-49ba-960f-63562e3011ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.180278 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163aa68-e437-49ba-960f-63562e3011ca admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:21.180574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163aa68-e437-49ba-960f-63562e3011ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:21.182204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163aa68-e437-49ba-960f-63562e3011ca admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:21.192449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-16ee9296-c94d-40ee-98ee-e6a1a69cd6c9 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:21.194039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-16ee9296-c94d-40ee-98ee-e6a1a69cd6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:21.198279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 146/287] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 2 07:14:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:21.203703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163aa68-e437-49ba-960f-63562e3011ca admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.203829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 142/288] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:14:21.221651 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163aa68-e437-49ba-960f-63562e3011ca admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.240706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982fb36-46d5-4edb-8db4-65c90d825eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.241908 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982fb36-46d5-4edb-8db4-65c90d825eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.242196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982fb36-46d5-4edb-8db4-65c90d825eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.242466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982fb36-46d5-4edb-8db4-65c90d825eaf admin admin] PATH_INFO: `/v3/groups/6056068cc66548be8d69df88cca7a9de` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.249868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982fb36-46d5-4edb-8db4-65c90d825eaf admin admin] RBAC: Authorizing `identity:get_group(group_id=6056068cc66548be8d69df88cca7a9de)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:21.251825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982fb36-46d5-4edb-8db4-65c90d825eaf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:21.253553 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 147/289] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 2 07:14:21 2022] GET /identity/v3/groups/6056068cc66548be8d69df88cca7a9de => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:21.259572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee9296-c94d-40ee-98ee-e6a1a69cd6c9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.270747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee9296-c94d-40ee-98ee-e6a1a69cd6c9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.277198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3661c02-356e-41a9-ba2e-80f0c49e88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.278175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3661c02-356e-41a9-ba2e-80f0c49e88c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.278646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3661c02-356e-41a9-ba2e-80f0c49e88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.279082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3661c02-356e-41a9-ba2e-80f0c49e88c6 admin admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.280411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3661c02-356e-41a9-ba2e-80f0c49e88c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:21.286957 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3661c02-356e-41a9-ba2e-80f0c49e88c6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:21.290234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 143/290] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 07:14:21 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:21.295554 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982fb36-46d5-4edb-8db4-65c90d825eaf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.306767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982fb36-46d5-4edb-8db4-65c90d825eaf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.319164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e1efa-800a-4703-b7d6-469b685d1492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.319907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e1efa-800a-4703-b7d6-469b685d1492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.320185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e1efa-800a-4703-b7d6-469b685d1492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.320574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e1efa-800a-4703-b7d6-469b685d1492 admin admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/groups/6056068cc66548be8d69df88cca7a9de/roles/2ba82c8be98e49f3a4e424556cab4bd3` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.322837 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e1efa-800a-4703-b7d6-469b685d1492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1231a1a5e54c6caf3fec16f606856a, group_id=6056068cc66548be8d69df88cca7a9de, role_id=2ba82c8be98e49f3a4e424556cab4bd3)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:21.325512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e1efa-800a-4703-b7d6-469b685d1492 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:21.347641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 148/291] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 2 07:14:21 2022] PUT /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a/groups/6056068cc66548be8d69df88cca7a9de/roles/2ba82c8be98e49f3a4e424556cab4bd3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:21.617914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3661c02-356e-41a9-ba2e-80f0c49e88c6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.630461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3661c02-356e-41a9-ba2e-80f0c49e88c6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.704979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e89170-8347-4012-a82e-d7d7776e3679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.705975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e89170-8347-4012-a82e-d7d7776e3679 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.706446 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e89170-8347-4012-a82e-d7d7776e3679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.706930 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e89170-8347-4012-a82e-d7d7776e3679 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.720408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e89170-8347-4012-a82e-d7d7776e3679 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e6e89170-8347-4012-a82e-d7d7776e3679 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:21.725694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:21.727126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:21.727895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:21.730534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 144/292] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 07:14:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:21.736925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e1efa-800a-4703-b7d6-469b685d1492 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.747566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e1efa-800a-4703-b7d6-469b685d1492 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.752367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2ddf-c48a-45b3-8bff-adef6d62be35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.753317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2ddf-c48a-45b3-8bff-adef6d62be35 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.753797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2ddf-c48a-45b3-8bff-adef6d62be35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.754277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2ddf-c48a-45b3-8bff-adef6d62be35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.755133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2ddf-c48a-45b3-8bff-adef6d62be35 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:21.755667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2ddf-c48a-45b3-8bff-adef6d62be35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:21.757513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2ddf-c48a-45b3-8bff-adef6d62be35 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:21.767646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 149/293] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 07:14:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:21.773418 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e89170-8347-4012-a82e-d7d7776e3679 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.784522 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e89170-8347-4012-a82e-d7d7776e3679 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.789561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3b1b4-3bed-4d78-b7bc-049b4cc291d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.790475 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3b1b4-3bed-4d78-b7bc-049b4cc291d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.790980 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3b1b4-3bed-4d78-b7bc-049b4cc291d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.791469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3b1b4-3bed-4d78-b7bc-049b4cc291d0 admin admin] PATH_INFO: `/v3/groups/ac99f60fe7bf4138952695a4285a4c62` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.798262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3b1b4-3bed-4d78-b7bc-049b4cc291d0 admin admin] RBAC: Authorizing `identity:get_group(group_id=ac99f60fe7bf4138952695a4285a4c62)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:21.800662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3b1b4-3bed-4d78-b7bc-049b4cc291d0 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:21.802847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 145/294] 10.222.0.13 () {56 vars in 1201 bytes} [Wed Nov 2 07:14:21 2022] GET /identity/v3/groups/ac99f60fe7bf4138952695a4285a4c62 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:21.808816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2ddf-c48a-45b3-8bff-adef6d62be35 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.819486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2ddf-c48a-45b3-8bff-adef6d62be35 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.824501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0d23a-fc11-468b-918b-1d83218614be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.825443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d23a-fc11-468b-918b-1d83218614be admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.825916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d23a-fc11-468b-918b-1d83218614be admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.826422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d23a-fc11-468b-918b-1d83218614be admin admin] PATH_INFO: `/v3/projects/2e777bb62ed84954afdd571094319647` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.827814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0d23a-fc11-468b-918b-1d83218614be admin admin] RBAC: Authorizing `identity:get_project(project_id=2e777bb62ed84954afdd571094319647)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:21.829917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0d23a-fc11-468b-918b-1d83218614be admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:21.832015 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 150/295] 10.222.0.13 () {56 vars in 1207 bytes} [Wed Nov 2 07:14:21 2022] GET /identity/v3/projects/2e777bb62ed84954afdd571094319647 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:21.838245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3b1b4-3bed-4d78-b7bc-049b4cc291d0 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:21.850077 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3b1b4-3bed-4d78-b7bc-049b4cc291d0 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:21.856854 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e96b0-687a-49e0-94e1-d8f5dc92bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:21.857991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e96b0-687a-49e0-94e1-d8f5dc92bf69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:21.858473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e96b0-687a-49e0-94e1-d8f5dc92bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:21.859012 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e96b0-687a-49e0-94e1-d8f5dc92bf69 admin admin] PATH_INFO: `/v3/projects/2e777bb62ed84954afdd571094319647/groups/ac99f60fe7bf4138952695a4285a4c62/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:21.861416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e96b0-687a-49e0-94e1-d8f5dc92bf69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e777bb62ed84954afdd571094319647, group_id=ac99f60fe7bf4138952695a4285a4c62, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:21.862735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-938e96b0-687a-49e0-94e1-d8f5dc92bf69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:14:21.862735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: warnings.warn(msg) Nov 02 07:14:21.862735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: Nov 02 07:14:21.865222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e96b0-687a-49e0-94e1-d8f5dc92bf69 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:21.884801 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 146/296] 10.222.0.13 () {58 vars in 1463 bytes} [Wed Nov 2 07:14:21 2022] PUT /identity/v3/projects/2e777bb62ed84954afdd571094319647/groups/ac99f60fe7bf4138952695a4285a4c62/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:22.814783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acd7d9-0701-4c33-b964-b261597c2b81 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:22.815792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acd7d9-0701-4c33-b964-b261597c2b81 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:22.816275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acd7d9-0701-4c33-b964-b261597c2b81 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:22.817834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 151/297] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:22.824171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff4443-6a61-4e63-97d9-6881f2b694d9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:22.824999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff4443-6a61-4e63-97d9-6881f2b694d9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:22.825507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff4443-6a61-4e63-97d9-6881f2b694d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:22.846426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-70ff4443-6a61-4e63-97d9-6881f2b694d9 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:22.847942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-70ff4443-6a61-4e63-97d9-6881f2b694d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:22.944286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 147/298] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:23.108156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8014b94-1871-4d0d-a9a3-6810e022d3f5 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:23.108756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8014b94-1871-4d0d-a9a3-6810e022d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:23.109254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8014b94-1871-4d0d-a9a3-6810e022d3f5 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:23.111051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 152/299] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:23.116103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a164a-3a84-4583-bef4-bb2b52880e0e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:23.116743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a164a-3a84-4583-bef4-bb2b52880e0e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:23.117463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a164a-3a84-4583-bef4-bb2b52880e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:23.140909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e84a164a-3a84-4583-bef4-bb2b52880e0e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:23.142494 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e84a164a-3a84-4583-bef4-bb2b52880e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:23.190339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:23.234223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 148/300] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:23.239647 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8014b94-1871-4d0d-a9a3-6810e022d3f5 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:23.366963 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8014b94-1871-4d0d-a9a3-6810e022d3f5 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:23.412422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a255b2d-2fd2-4de0-ab6f-dcb7f4d478bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:23.413071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a255b2d-2fd2-4de0-ab6f-dcb7f4d478bf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:23.414042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a255b2d-2fd2-4de0-ab6f-dcb7f4d478bf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:23.414280 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a255b2d-2fd2-4de0-ab6f-dcb7f4d478bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:23.429910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a255b2d-2fd2-4de0-ab6f-dcb7f4d478bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0a255b2d-2fd2-4de0-ab6f-dcb7f4d478bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:23.435197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:23.436068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:23.436892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 153/301] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:23.442322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a164a-3a84-4583-bef4-bb2b52880e0e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:23.602124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a255b2d-2fd2-4de0-ab6f-dcb7f4d478bf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:23.611146 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a164a-3a84-4583-bef4-bb2b52880e0e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:23.650059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:23.655802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47943-33be-4635-969b-6ddd84d577a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:23.656672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47943-33be-4635-969b-6ddd84d577a2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:23.659302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47943-33be-4635-969b-6ddd84d577a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:23.659797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47943-33be-4635-969b-6ddd84d577a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:23.660703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47943-33be-4635-969b-6ddd84d577a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:23.661231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47943-33be-4635-969b-6ddd84d577a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:23.662871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47943-33be-4635-969b-6ddd84d577a2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:23.673861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 149/302] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:23.688889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47943-33be-4635-969b-6ddd84d577a2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:23.745046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:23.759641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a255b2d-2fd2-4de0-ab6f-dcb7f4d478bf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:23.797265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44bcd5-19c2-4a7e-8c18-bc1f11163405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:23.797998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44bcd5-19c2-4a7e-8c18-bc1f11163405 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:23.798279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44bcd5-19c2-4a7e-8c18-bc1f11163405 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:23.798649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44bcd5-19c2-4a7e-8c18-bc1f11163405 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:23.814656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44bcd5-19c2-4a7e-8c18-bc1f11163405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-6e44bcd5-19c2-4a7e-8c18-bc1f11163405 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:23.821175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:23.822477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:23.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 154/303] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:14:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:23.823901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55fc8-a6b9-4f92-9faa-38ba5cd66d25 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:23.823901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55fc8-a6b9-4f92-9faa-38ba5cd66d25 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:23.824589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf55fc8-a6b9-4f92-9faa-38ba5cd66d25 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:23.829042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 155/304] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:23.829042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf55fc8-a6b9-4f92-9faa-38ba5cd66d25 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:23.844608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47943-33be-4635-969b-6ddd84d577a2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:23.881586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e734-6fcc-49c8-abfd-30ed5becf722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:23.882856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e734-6fcc-49c8-abfd-30ed5becf722 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:23.883205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e734-6fcc-49c8-abfd-30ed5becf722 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:23.883389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e734-6fcc-49c8-abfd-30ed5becf722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:23.926921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:23.956206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf55fc8-a6b9-4f92-9faa-38ba5cd66d25 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:23.999849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011e734-6fcc-49c8-abfd-30ed5becf722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:24.001352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011e734-6fcc-49c8-abfd-30ed5becf722 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:24.007246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095f8b0-9800-47fb-85e4-8466ec327300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:24.008128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095f8b0-9800-47fb-85e4-8466ec327300 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:24.008617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095f8b0-9800-47fb-85e4-8466ec327300 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:24.009111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095f8b0-9800-47fb-85e4-8466ec327300 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:24.009980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095f8b0-9800-47fb-85e4-8466ec327300 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:24.010470 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095f8b0-9800-47fb-85e4-8466ec327300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:24.012669 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095f8b0-9800-47fb-85e4-8466ec327300 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:24.025616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 156/305] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:24.027556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddb593-d5d3-4329-8e15-0de76af9abbb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:24.028071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddb593-d5d3-4329-8e15-0de76af9abbb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:24.028531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddb593-d5d3-4329-8e15-0de76af9abbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:24.046760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:24.058010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-03ddb593-d5d3-4329-8e15-0de76af9abbb None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:24.059565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-03ddb593-d5d3-4329-8e15-0de76af9abbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:24.128072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 150/306] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 07:14:24.129354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e734-6fcc-49c8-abfd-30ed5becf722 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:24.140054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 157/307] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:24.140903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddb593-d5d3-4329-8e15-0de76af9abbb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:24.218657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:24.261063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddb593-d5d3-4329-8e15-0de76af9abbb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:24.284261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e734-6fcc-49c8-abfd-30ed5becf722 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:24.296516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44859-dd09-4df0-9836-6acc1fd5e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:24.297205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44859-dd09-4df0-9836-6acc1fd5e106 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:24.297483 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44859-dd09-4df0-9836-6acc1fd5e106 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:24.297752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44859-dd09-4df0-9836-6acc1fd5e106 None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:24.299006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa44859-dd09-4df0-9836-6acc1fd5e106 None admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:24.300449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa44859-dd09-4df0-9836-6acc1fd5e106 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:24.302310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 158/308] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:24 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:24.308576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44859-dd09-4df0-9836-6acc1fd5e106 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:24.333786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:24.348965 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b51fe-4c9b-4144-ace6-7f100aae32d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:24.349698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b51fe-4c9b-4144-ace6-7f100aae32d0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:24.349975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b51fe-4c9b-4144-ace6-7f100aae32d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:24.350241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b51fe-4c9b-4144-ace6-7f100aae32d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:24.417818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44859-dd09-4df0-9836-6acc1fd5e106 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:24.425219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b51fe-4c9b-4144-ace6-7f100aae32d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:24.426859 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b51fe-4c9b-4144-ace6-7f100aae32d0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:24.454063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31e946-8f26-4d9e-ac23-46bd5a98f631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:24.454695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e946-8f26-4d9e-ac23-46bd5a98f631 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:24.454975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e946-8f26-4d9e-ac23-46bd5a98f631 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:24.455248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e946-8f26-4d9e-ac23-46bd5a98f631 None admin] PATH_INFO: `/v3/groups/6056068cc66548be8d69df88cca7a9de` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:24.456364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31e946-8f26-4d9e-ac23-46bd5a98f631 None admin] RBAC: Authorizing `identity:get_group(group_id=6056068cc66548be8d69df88cca7a9de)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:24.457914 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31e946-8f26-4d9e-ac23-46bd5a98f631 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:24.464475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 159/309] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Nov 2 07:14:24 2022] GET /identity/v3/groups/6056068cc66548be8d69df88cca7a9de => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:24.465833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181f06b-d259-4aef-94e0-ee9119c1ce4c None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:24.466371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181f06b-d259-4aef-94e0-ee9119c1ce4c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:24.466648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181f06b-d259-4aef-94e0-ee9119c1ce4c None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:24.467989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 160/310] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:24.470064 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181f06b-d259-4aef-94e0-ee9119c1ce4c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:24.477179 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:24.556931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 151/311] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:14:24.564061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f7cbb-7635-4648-9d9d-490f6c84f8bb None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:24.564600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f7cbb-7635-4648-9d9d-490f6c84f8bb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:24.565089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f7cbb-7635-4648-9d9d-490f6c84f8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:24.583960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-033f7cbb-7635-4648-9d9d-490f6c84f8bb None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:24.585549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-033f7cbb-7635-4648-9d9d-490f6c84f8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:24.601822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181f06b-d259-4aef-94e0-ee9119c1ce4c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:24.617155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:24.649070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194733cf-4911-4e79-b414-9883c5c31408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:24.649690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194733cf-4911-4e79-b414-9883c5c31408 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:24.649970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194733cf-4911-4e79-b414-9883c5c31408 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:24.650242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194733cf-4911-4e79-b414-9883c5c31408 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:24.650972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194733cf-4911-4e79-b414-9883c5c31408 None admin] RBAC: Adding query filter params (group.id=6056068cc66548be8d69df88cca7a9de, role.id=30142fe6cc4944d988168c210fc8c902, scope.project.id=18b9124303d64d28bc970b0635e31a5a) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:24.651279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194733cf-4911-4e79-b414-9883c5c31408 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:24.652819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194733cf-4911-4e79-b414-9883c5c31408 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:24.661094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 161/312] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Nov 2 07:14:24 2022] GET /identity/v3/role_assignments?group.id=6056068cc66548be8d69df88cca7a9de&scope.project.id=18b9124303d64d28bc970b0635e31a5a&role.id=30142fe6cc4944d988168c210fc8c902 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:24.662682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194733cf-4911-4e79-b414-9883c5c31408 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:24.669362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 152/313] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:24.670516 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f7cbb-7635-4648-9d9d-490f6c84f8bb None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:24.744431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:24.782552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194733cf-4911-4e79-b414-9883c5c31408 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:24.805662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f7cbb-7635-4648-9d9d-490f6c84f8bb None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:24.822459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb6d13-bd7b-4ef8-9766-743060051dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:24.823273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb6d13-bd7b-4ef8-9766-743060051dbd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:24.823612 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb6d13-bd7b-4ef8-9766-743060051dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:24.823948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb6d13-bd7b-4ef8-9766-743060051dbd None admin] PATH_INFO: `/v3/projects/18b9124303d64d28bc970b0635e31a5a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:24.825521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb6d13-bd7b-4ef8-9766-743060051dbd None admin] RBAC: Authorizing `identity:get_project(project_id=18b9124303d64d28bc970b0635e31a5a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:24.827112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb6d13-bd7b-4ef8-9766-743060051dbd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:24.833466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 162/314] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:24 2022] GET /identity/v3/projects/18b9124303d64d28bc970b0635e31a5a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:24.836595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb6d13-bd7b-4ef8-9766-743060051dbd None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:24.849400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ef1e-48eb-4ac2-a882-8d73854e8f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:24.850694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ef1e-48eb-4ac2-a882-8d73854e8f81 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:24.851320 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ef1e-48eb-4ac2-a882-8d73854e8f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:24.851776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ef1e-48eb-4ac2-a882-8d73854e8f81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:24.865279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26ef1e-48eb-4ac2-a882-8d73854e8f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-da26ef1e-48eb-4ac2-a882-8d73854e8f81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:24.871585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:24.872517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:14:24.873723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:24.876086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 153/315] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:24.881781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ef1e-48eb-4ac2-a882-8d73854e8f81 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:24.919803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:24.963690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb6d13-bd7b-4ef8-9766-743060051dbd None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:25.002484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd6a2-70b2-44dd-a3b5-bea54f353247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:25.003533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd6a2-70b2-44dd-a3b5-bea54f353247 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.003968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd6a2-70b2-44dd-a3b5-bea54f353247 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.004466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd6a2-70b2-44dd-a3b5-bea54f353247 None admin] PATH_INFO: `/v3/groups/6056068cc66548be8d69df88cca7a9de` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.005848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffd6a2-70b2-44dd-a3b5-bea54f353247 None admin] RBAC: Authorizing `identity:get_group(group_id=6056068cc66548be8d69df88cca7a9de)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:25.007511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ef1e-48eb-4ac2-a882-8d73854e8f81 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:25.008003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffd6a2-70b2-44dd-a3b5-bea54f353247 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:25.010339 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 163/316] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Nov 2 07:14:24 2022] GET /identity/v3/groups/6056068cc66548be8d69df88cca7a9de => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:25.016282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd6a2-70b2-44dd-a3b5-bea54f353247 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:25.020637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:25.047120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45d78d-c06c-4bab-ada3-579ba5f8962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:25.047735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d78d-c06c-4bab-ada3-579ba5f8962a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.048015 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d78d-c06c-4bab-ada3-579ba5f8962a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.048284 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d78d-c06c-4bab-ada3-579ba5f8962a None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.049037 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45d78d-c06c-4bab-ada3-579ba5f8962a None admin] RBAC: Adding query filter params (name=member) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:25.049346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45d78d-c06c-4bab-ada3-579ba5f8962a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:25.050798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45d78d-c06c-4bab-ada3-579ba5f8962a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:25.060558 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 154/317] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:14:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:25.070348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45d78d-c06c-4bab-ada3-579ba5f8962a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:25.149239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd6a2-70b2-44dd-a3b5-bea54f353247 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:25.171986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:25.189894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376cca1-4ee3-4a1e-a2ac-2da093b79557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:25.190978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376cca1-4ee3-4a1e-a2ac-2da093b79557 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.190978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376cca1-4ee3-4a1e-a2ac-2da093b79557 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.191172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376cca1-4ee3-4a1e-a2ac-2da093b79557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.191741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376cca1-4ee3-4a1e-a2ac-2da093b79557 None admin] RBAC: Adding query filter params (group.id=6056068cc66548be8d69df88cca7a9de, role.id=2ba82c8be98e49f3a4e424556cab4bd3, scope.project.id=18b9124303d64d28bc970b0635e31a5a) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:25.192828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45d78d-c06c-4bab-ada3-579ba5f8962a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:25.192937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376cca1-4ee3-4a1e-a2ac-2da093b79557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:25.193490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376cca1-4ee3-4a1e-a2ac-2da093b79557 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:25.200554 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 164/318] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Nov 2 07:14:25 2022] GET /identity/v3/role_assignments?group.id=6056068cc66548be8d69df88cca7a9de&scope.project.id=18b9124303d64d28bc970b0635e31a5a&role.id=2ba82c8be98e49f3a4e424556cab4bd3 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:25.201581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66620dec-d5d6-4fe3-b7de-7c6182f749bf None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.202277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66620dec-d5d6-4fe3-b7de-7c6182f749bf None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.202277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66620dec-d5d6-4fe3-b7de-7c6182f749bf None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.204732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 165/319] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:25.205340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66620dec-d5d6-4fe3-b7de-7c6182f749bf None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:25.234998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985d08c-1046-411d-b2c4-1d47e765fa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:25.235650 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985d08c-1046-411d-b2c4-1d47e765fa17 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.235922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985d08c-1046-411d-b2c4-1d47e765fa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.236187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985d08c-1046-411d-b2c4-1d47e765fa17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.311495 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:25.348975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985d08c-1046-411d-b2c4-1d47e765fa17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:25.351654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985d08c-1046-411d-b2c4-1d47e765fa17 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:25.360386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66620dec-d5d6-4fe3-b7de-7c6182f749bf None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:25.405496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb614e1-6745-4ae9-af32-48404cff9583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:25.406516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb614e1-6745-4ae9-af32-48404cff9583 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.407000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb614e1-6745-4ae9-af32-48404cff9583 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.407778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb614e1-6745-4ae9-af32-48404cff9583 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.422880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb614e1-6745-4ae9-af32-48404cff9583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9eb614e1-6745-4ae9-af32-48404cff9583 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:25.428838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:25.430117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:25.430894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 166/320] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:14:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:25.436571 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b1bb5-5b74-4c82-b0db-e0070dbc2d37 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.436855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b1bb5-5b74-4c82-b0db-e0070dbc2d37 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.438067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b1bb5-5b74-4c82-b0db-e0070dbc2d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.459832 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-066b1bb5-5b74-4c82-b0db-e0070dbc2d37 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:25.461711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-066b1bb5-5b74-4c82-b0db-e0070dbc2d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:25.465548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:25.484289 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 155/321] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 07:14:25.490033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985d08c-1046-411d-b2c4-1d47e765fa17 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:25.545793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 167/322] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:25.546236 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b1bb5-5b74-4c82-b0db-e0070dbc2d37 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:25.602816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985d08c-1046-411d-b2c4-1d47e765fa17 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:25.623167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:25.648535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0979a6d-b06f-44aa-a1b6-31e8ca9f36e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:25.649186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979a6d-b06f-44aa-a1b6-31e8ca9f36e3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.649456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979a6d-b06f-44aa-a1b6-31e8ca9f36e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.649720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979a6d-b06f-44aa-a1b6-31e8ca9f36e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.651207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0979a6d-b06f-44aa-a1b6-31e8ca9f36e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:25.651503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0979a6d-b06f-44aa-a1b6-31e8ca9f36e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:25.652873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0979a6d-b06f-44aa-a1b6-31e8ca9f36e3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:25.662781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 156/323] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:25.668908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0979a6d-b06f-44aa-a1b6-31e8ca9f36e3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:25.680156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b1bb5-5b74-4c82-b0db-e0070dbc2d37 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:25.726884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c23401-5710-4683-ac62-0f305a0792e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:25.727990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23401-5710-4683-ac62-0f305a0792e7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.727990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23401-5710-4683-ac62-0f305a0792e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.727990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23401-5710-4683-ac62-0f305a0792e7 None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.729248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:25.731003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c23401-5710-4683-ac62-0f305a0792e7 None admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:25.732405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c23401-5710-4683-ac62-0f305a0792e7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:25.734374 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 168/324] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:25 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:25.740102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c23401-5710-4683-ac62-0f305a0792e7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:25.804718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0979a6d-b06f-44aa-a1b6-31e8ca9f36e3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:25.848283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebac03a-acc9-4a0c-a728-cb2eec716b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:25.848894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebac03a-acc9-4a0c-a728-cb2eec716b87 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.849203 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebac03a-acc9-4a0c-a728-cb2eec716b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.849476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebac03a-acc9-4a0c-a728-cb2eec716b87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.873768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c23401-5710-4683-ac62-0f305a0792e7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:25.905120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:25.920646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0c228-ab9c-42c4-ad72-ba9c03153b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:25.921394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0c228-ab9c-42c4-ad72-ba9c03153b19 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:25.921666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0c228-ab9c-42c4-ad72-ba9c03153b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:25.921932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0c228-ab9c-42c4-ad72-ba9c03153b19 None admin] PATH_INFO: `/v3/groups/6056068cc66548be8d69df88cca7a9de` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:25.923061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0c228-ab9c-42c4-ad72-ba9c03153b19 None admin] RBAC: Authorizing `identity:get_group(group_id=6056068cc66548be8d69df88cca7a9de)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:25.924509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0c228-ab9c-42c4-ad72-ba9c03153b19 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:25.926260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 169/325] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Nov 2 07:14:25 2022] GET /identity/v3/groups/6056068cc66548be8d69df88cca7a9de => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:25.926857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0c228-ab9c-42c4-ad72-ba9c03153b19 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:25.934097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebac03a-acc9-4a0c-a728-cb2eec716b87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:25.935569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebac03a-acc9-4a0c-a728-cb2eec716b87 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:25.990043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:26.053907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0c228-ab9c-42c4-ad72-ba9c03153b19 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:26.054642 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 157/326] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 07:14:26.055496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebac03a-acc9-4a0c-a728-cb2eec716b87 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:26.093953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e5759-8897-4add-8d29-84dc5f704e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:26.094689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e5759-8897-4add-8d29-84dc5f704e8d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:26.094959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e5759-8897-4add-8d29-84dc5f704e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:26.095224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e5759-8897-4add-8d29-84dc5f704e8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:26.107535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e5759-8897-4add-8d29-84dc5f704e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-3d9e5759-8897-4add-8d29-84dc5f704e8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:26.112449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:26.113573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 170/327] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:26.114492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e5759-8897-4add-8d29-84dc5f704e8d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:26.178628 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebac03a-acc9-4a0c-a728-cb2eec716b87 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:26.186215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:26.222689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d25eb-f639-4bc4-83a4-42dc2dd48eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:26.223230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d25eb-f639-4bc4-83a4-42dc2dd48eba None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:26.223503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d25eb-f639-4bc4-83a4-42dc2dd48eba None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:26.223789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d25eb-f639-4bc4-83a4-42dc2dd48eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:26.224518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d25eb-f639-4bc4-83a4-42dc2dd48eba None admin] RBAC: Adding query filter params (group.id=6056068cc66548be8d69df88cca7a9de, role.id=30142fe6cc4944d988168c210fc8c902, scope.project.id=ab1231a1a5e54c6caf3fec16f606856a) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:26.225510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d25eb-f639-4bc4-83a4-42dc2dd48eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:26.227494 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d25eb-f639-4bc4-83a4-42dc2dd48eba None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:26.233873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 158/328] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Nov 2 07:14:26 2022] GET /identity/v3/role_assignments?group.id=6056068cc66548be8d69df88cca7a9de&scope.project.id=ab1231a1a5e54c6caf3fec16f606856a&role.id=30142fe6cc4944d988168c210fc8c902 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:26.234751 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d25eb-f639-4bc4-83a4-42dc2dd48eba None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:26.242474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e5759-8897-4add-8d29-84dc5f704e8d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:26.248615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:26.283474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e93b2-0fae-4bd1-bcac-4707d3f7a0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:26.284112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e93b2-0fae-4bd1-bcac-4707d3f7a0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:26.284379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e93b2-0fae-4bd1-bcac-4707d3f7a0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:26.284646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e93b2-0fae-4bd1-bcac-4707d3f7a0a7 None admin] PATH_INFO: `/v3/projects/ab1231a1a5e54c6caf3fec16f606856a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:26.285884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e93b2-0fae-4bd1-bcac-4707d3f7a0a7 None admin] RBAC: Authorizing `identity:get_project(project_id=ab1231a1a5e54c6caf3fec16f606856a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:26.287350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e93b2-0fae-4bd1-bcac-4707d3f7a0a7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:26.289215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 171/329] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:26 2022] GET /identity/v3/projects/ab1231a1a5e54c6caf3fec16f606856a => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:26.295222 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e93b2-0fae-4bd1-bcac-4707d3f7a0a7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:26.357596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d25eb-f639-4bc4-83a4-42dc2dd48eba None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:26.396443 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d550ebc-3d07-470d-9486-1432c85b167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:26.397097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d550ebc-3d07-470d-9486-1432c85b167a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:26.397378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d550ebc-3d07-470d-9486-1432c85b167a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:26.397649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d550ebc-3d07-470d-9486-1432c85b167a None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:26.399609 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d550ebc-3d07-470d-9486-1432c85b167a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:26.399914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d550ebc-3d07-470d-9486-1432c85b167a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:26.401319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d550ebc-3d07-470d-9486-1432c85b167a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:26.410663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 159/330] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:26.416277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d550ebc-3d07-470d-9486-1432c85b167a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:26.419970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e93b2-0fae-4bd1-bcac-4707d3f7a0a7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:26.448742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:26.465985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8547b-d3c2-4848-ab00-63e781edaf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:26.466877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8547b-d3c2-4848-ab00-63e781edaf57 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:26.467157 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8547b-d3c2-4848-ab00-63e781edaf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:26.467427 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8547b-d3c2-4848-ab00-63e781edaf57 None admin] PATH_INFO: `/v3/groups/6056068cc66548be8d69df88cca7a9de` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:26.468549 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8547b-d3c2-4848-ab00-63e781edaf57 None admin] RBAC: Authorizing `identity:get_group(group_id=6056068cc66548be8d69df88cca7a9de)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:26.470013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8547b-d3c2-4848-ab00-63e781edaf57 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:26.471582 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 172/331] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Nov 2 07:14:26 2022] GET /identity/v3/groups/6056068cc66548be8d69df88cca7a9de => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:26.478030 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8547b-d3c2-4848-ab00-63e781edaf57 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:26.498217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:26.534246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d550ebc-3d07-470d-9486-1432c85b167a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:26.572125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f120a-07ae-4760-b62f-670600c72a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:26.572737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f120a-07ae-4760-b62f-670600c72a1b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:26.573024 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f120a-07ae-4760-b62f-670600c72a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:26.573300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f120a-07ae-4760-b62f-670600c72a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:26.600012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8547b-d3c2-4848-ab00-63e781edaf57 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:26.638944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edeaa4-e086-47c0-82ca-666b857ceb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:26.639547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edeaa4-e086-47c0-82ca-666b857ceb5d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:26.639820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edeaa4-e086-47c0-82ca-666b857ceb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:26.640092 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edeaa4-e086-47c0-82ca-666b857ceb5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:26.640807 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edeaa4-e086-47c0-82ca-666b857ceb5d None admin] RBAC: Adding query filter params (group.id=6056068cc66548be8d69df88cca7a9de, role.id=2ba82c8be98e49f3a4e424556cab4bd3, scope.project.id=ab1231a1a5e54c6caf3fec16f606856a) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:26.641149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edeaa4-e086-47c0-82ca-666b857ceb5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:26.642562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edeaa4-e086-47c0-82ca-666b857ceb5d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:26.648702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 173/332] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Nov 2 07:14:26 2022] GET /identity/v3/role_assignments?group.id=6056068cc66548be8d69df88cca7a9de&scope.project.id=ab1231a1a5e54c6caf3fec16f606856a&role.id=2ba82c8be98e49f3a4e424556cab4bd3 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:26.649532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f120a-07ae-4760-b62f-670600c72a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:26.650973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f120a-07ae-4760-b62f-670600c72a1b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:26.724803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:26.758287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 160/333] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 07:14:26.764082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edeaa4-e086-47c0-82ca-666b857ceb5d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:26.823005 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:26.870834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edeaa4-e086-47c0-82ca-666b857ceb5d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:26.906086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ab053-13d4-4691-9441-4f0381cb0e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:26.906714 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ab053-13d4-4691-9441-4f0381cb0e6c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:26.906989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ab053-13d4-4691-9441-4f0381cb0e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:26.907258 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ab053-13d4-4691-9441-4f0381cb0e6c None admin] PATH_INFO: `/v3/projects/2e777bb62ed84954afdd571094319647` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:26.910506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ab053-13d4-4691-9441-4f0381cb0e6c None admin] RBAC: Authorizing `identity:get_project(project_id=2e777bb62ed84954afdd571094319647)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:26.910506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ab053-13d4-4691-9441-4f0381cb0e6c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:26.912868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 174/334] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:14:26 2022] GET /identity/v3/projects/2e777bb62ed84954afdd571094319647 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:26.917943 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f120a-07ae-4760-b62f-670600c72a1b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:27.018682 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f120a-07ae-4760-b62f-670600c72a1b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:27.051864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3fe23-dcbd-4694-914e-8dc2ead00cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:27.052477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3fe23-dcbd-4694-914e-8dc2ead00cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:27.052745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3fe23-dcbd-4694-914e-8dc2ead00cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:27.053030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3fe23-dcbd-4694-914e-8dc2ead00cb8 None admin] PATH_INFO: `/v3/groups/ac99f60fe7bf4138952695a4285a4c62` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:27.054742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3fe23-dcbd-4694-914e-8dc2ead00cb8 None admin] RBAC: Authorizing `identity:get_group(group_id=ac99f60fe7bf4138952695a4285a4c62)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:27.056153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3fe23-dcbd-4694-914e-8dc2ead00cb8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:27.057734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 161/335] 10.222.0.13 () {56 vars in 1180 bytes} [Wed Nov 2 07:14:26 2022] GET /identity/v3/groups/ac99f60fe7bf4138952695a4285a4c62 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:27.063488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ab053-13d4-4691-9441-4f0381cb0e6c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:27.160042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ab053-13d4-4691-9441-4f0381cb0e6c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:27.182208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:27.193584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd71a6c-2ea1-459f-997c-a01be17eb129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:27.194168 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd71a6c-2ea1-459f-997c-a01be17eb129 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:27.194439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd71a6c-2ea1-459f-997c-a01be17eb129 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:27.194795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd71a6c-2ea1-459f-997c-a01be17eb129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:27.196000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd71a6c-2ea1-459f-997c-a01be17eb129 None admin] RBAC: Adding query filter params (group.id=ac99f60fe7bf4138952695a4285a4c62, role.id=6a01757540e64fed9041997458bd64e5, scope.project.id=2e777bb62ed84954afdd571094319647) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:27.196285 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd71a6c-2ea1-459f-997c-a01be17eb129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:27.197737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd71a6c-2ea1-459f-997c-a01be17eb129 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:27.203203 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 175/336] 10.222.0.13 () {56 vars in 1376 bytes} [Wed Nov 2 07:14:27 2022] GET /identity/v3/role_assignments?group.id=ac99f60fe7bf4138952695a4285a4c62&scope.project.id=2e777bb62ed84954afdd571094319647&role.id=6a01757540e64fed9041997458bd64e5 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:30.060587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c89949-9bf9-4819-917d-0fbb17975389 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.060587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c89949-9bf9-4819-917d-0fbb17975389 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.060587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c89949-9bf9-4819-917d-0fbb17975389 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.060587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 162/337] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:30.066811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede145f4-4e1c-4a0d-81a9-65574cf5f76a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.067238 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede145f4-4e1c-4a0d-81a9-65574cf5f76a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.067355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede145f4-4e1c-4a0d-81a9-65574cf5f76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.093980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ede145f4-4e1c-4a0d-81a9-65574cf5f76a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:30.095457 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ede145f4-4e1c-4a0d-81a9-65574cf5f76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:30.103221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aa488-e46f-4af3-92a3-edbb8179f958 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.103803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aa488-e46f-4af3-92a3-edbb8179f958 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.104225 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8aa488-e46f-4af3-92a3-edbb8179f958 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.105948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 163/338] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:30.108699 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95ead9-52ac-4b4b-aaa5-028e7ae9aec4 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.109162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95ead9-52ac-4b4b-aaa5-028e7ae9aec4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.109593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95ead9-52ac-4b4b-aaa5-028e7ae9aec4 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.110911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 164/339] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:14:30.114746 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51697a50-74fe-4884-a9d5-f8b13cd5c50e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.115193 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51697a50-74fe-4884-a9d5-f8b13cd5c50e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.115611 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51697a50-74fe-4884-a9d5-f8b13cd5c50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.138456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-51697a50-74fe-4884-a9d5-f8b13cd5c50e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:30.139877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-51697a50-74fe-4884-a9d5-f8b13cd5c50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:30.171647 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 176/340] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:30.173469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1867f6-8d96-431c-b68e-dbf7cfca1ebc None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.173910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1867f6-8d96-431c-b68e-dbf7cfca1ebc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.174343 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1867f6-8d96-431c-b68e-dbf7cfca1ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.176444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:30.193863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8b1867f6-8d96-431c-b68e-dbf7cfca1ebc None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:30.195280 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8b1867f6-8d96-431c-b68e-dbf7cfca1ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:30.212016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 165/341] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:30.268126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 177/342] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:30.499048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51697a50-74fe-4884-a9d5-f8b13cd5c50e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:30.530685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1867f6-8d96-431c-b68e-dbf7cfca1ebc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:30.593357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:30.625530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51697a50-74fe-4884-a9d5-f8b13cd5c50e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:30.650092 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1867f6-8d96-431c-b68e-dbf7cfca1ebc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:30.661133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdddf3d-68b3-49ba-aa5d-4fc6600873e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:30.661762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdddf3d-68b3-49ba-aa5d-4fc6600873e0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.662036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdddf3d-68b3-49ba-aa5d-4fc6600873e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.662328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdddf3d-68b3-49ba-aa5d-4fc6600873e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.672953 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdddf3d-68b3-49ba-aa5d-4fc6600873e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:30.674421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdddf3d-68b3-49ba-aa5d-4fc6600873e0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:30.687804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86d780-c6a1-4ed4-af26-8b92ba031076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:30.688620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86d780-c6a1-4ed4-af26-8b92ba031076 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.689062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86d780-c6a1-4ed4-af26-8b92ba031076 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.689485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86d780-c6a1-4ed4-af26-8b92ba031076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-efdddf3d-68b3-49ba-aa5d-4fc6600873e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:30.690097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:30.691198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:30.692257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:30.692257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:30.692257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:30.692257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 166/343] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:30.692735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bc5cc-02c6-46ba-bd85-75b41150821b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.693029 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bc5cc-02c6-46ba-bd85-75b41150821b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.693302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bc5cc-02c6-46ba-bd85-75b41150821b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.694524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 167/344] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:30.695249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bc5cc-02c6-46ba-bd85-75b41150821b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:30.707399 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86d780-c6a1-4ed4-af26-8b92ba031076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:30.709218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86d780-c6a1-4ed4-af26-8b92ba031076 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:30.720282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-2d86d780-c6a1-4ed4-af26-8b92ba031076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:30.727863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:30.728728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:30.729618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:30.729618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:30.729618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:30.730264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 178/345] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:30.731031 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86d780-c6a1-4ed4-af26-8b92ba031076 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:30.805346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bc5cc-02c6-46ba-bd85-75b41150821b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:30.836805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:30.840616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86d780-c6a1-4ed4-af26-8b92ba031076 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:30.842324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394e64d-e222-4c7f-9ac6-2e6a5e738823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:30.843039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394e64d-e222-4c7f-9ac6-2e6a5e738823 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.843424 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394e64d-e222-4c7f-9ac6-2e6a5e738823 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.844373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394e64d-e222-4c7f-9ac6-2e6a5e738823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.855484 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394e64d-e222-4c7f-9ac6-2e6a5e738823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:30.856926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394e64d-e222-4c7f-9ac6-2e6a5e738823 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-c394e64d-e222-4c7f-9ac6-2e6a5e738823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:30.872013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:30.872918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:30.873786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:30.873786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:30.873786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:30.873786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 168/346] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:30.874748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e0482-1319-491d-b6dd-76e406ac17fb None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.874855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e0482-1319-491d-b6dd-76e406ac17fb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.875102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e0482-1319-491d-b6dd-76e406ac17fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.879324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432635-9993-4f72-8e33-6f72a62e470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:30.879929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432635-9993-4f72-8e33-6f72a62e470b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:30.880204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432635-9993-4f72-8e33-6f72a62e470b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:30.880473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432635-9993-4f72-8e33-6f72a62e470b None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:30.881151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd432635-9993-4f72-8e33-6f72a62e470b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:30.881454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd432635-9993-4f72-8e33-6f72a62e470b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:30.882893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd432635-9993-4f72-8e33-6f72a62e470b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:30.893995 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-163e0482-1319-491d-b6dd-76e406ac17fb None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:30.895149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 179/347] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:30.895278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-163e0482-1319-491d-b6dd-76e406ac17fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:30.895794 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432635-9993-4f72-8e33-6f72a62e470b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:30.971136 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 169/348] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:30.971974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e0482-1319-491d-b6dd-76e406ac17fb None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:30.982286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:31.022385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432635-9993-4f72-8e33-6f72a62e470b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:31.065563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3193b8-84d9-4cab-bee2-1c8d1fe58228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:31.066398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3193b8-84d9-4cab-bee2-1c8d1fe58228 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:31.066816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3193b8-84d9-4cab-bee2-1c8d1fe58228 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:31.067253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3193b8-84d9-4cab-bee2-1c8d1fe58228 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:31.069235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3193b8-84d9-4cab-bee2-1c8d1fe58228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:31.069813 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3193b8-84d9-4cab-bee2-1c8d1fe58228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:31.071741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3193b8-84d9-4cab-bee2-1c8d1fe58228 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:31.091723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 180/349] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:31.091723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3193b8-84d9-4cab-bee2-1c8d1fe58228 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:31.096290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e0482-1319-491d-b6dd-76e406ac17fb None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:31.116000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:31.136373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cd0fb-0f85-405e-a931-34b2a9e69208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:31.137096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cd0fb-0f85-405e-a931-34b2a9e69208 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:31.137449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cd0fb-0f85-405e-a931-34b2a9e69208 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:31.137816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cd0fb-0f85-405e-a931-34b2a9e69208 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:31.139987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cd0fb-0f85-405e-a931-34b2a9e69208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:31.140360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cd0fb-0f85-405e-a931-34b2a9e69208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:31.141816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cd0fb-0f85-405e-a931-34b2a9e69208 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:31.157793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 170/350] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:31.161512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cd0fb-0f85-405e-a931-34b2a9e69208 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:31.228065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3193b8-84d9-4cab-bee2-1c8d1fe58228 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:31.245130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:31.274231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79936d-c4c7-4d75-9d95-6736dbd5499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:31.274828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79936d-c4c7-4d75-9d95-6736dbd5499d None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:31.275458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79936d-c4c7-4d75-9d95-6736dbd5499d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:31.275742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79936d-c4c7-4d75-9d95-6736dbd5499d None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:31.276386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79936d-c4c7-4d75-9d95-6736dbd5499d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:31.277833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79936d-c4c7-4d75-9d95-6736dbd5499d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:31.288231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cd0fb-0f85-405e-a931-34b2a9e69208 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:31.299723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 181/351] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:14:31 2022] POST /identity/v3/users => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:31.300717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79936d-c4c7-4d75-9d95-6736dbd5499d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:31.350432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29c2d4-7935-45e0-b4b9-69d1f68743fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:31.351524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29c2d4-7935-45e0-b4b9-69d1f68743fe None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:31.351803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29c2d4-7935-45e0-b4b9-69d1f68743fe None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:31.352073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29c2d4-7935-45e0-b4b9-69d1f68743fe None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:31.353651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29c2d4-7935-45e0-b4b9-69d1f68743fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:31.355302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29c2d4-7935-45e0-b4b9-69d1f68743fe None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:31.388723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 171/352] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:14:31 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:31.394257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29c2d4-7935-45e0-b4b9-69d1f68743fe None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:31.420144 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:31.454246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79936d-c4c7-4d75-9d95-6736dbd5499d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:31.525307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e19f57-e3d3-44b8-92cb-1b516c23e4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:31.526238 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e19f57-e3d3-44b8-92cb-1b516c23e4ee None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:31.526734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e19f57-e3d3-44b8-92cb-1b516c23e4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:31.527213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e19f57-e3d3-44b8-92cb-1b516c23e4ee None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:31.528081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e19f57-e3d3-44b8-92cb-1b516c23e4ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:31.531387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e19f57-e3d3-44b8-92cb-1b516c23e4ee None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:31.557233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 182/353] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:14:31 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:31.558332 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc6a92-70a9-410c-b9c1-6fe18436ea36 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:31.558617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc6a92-70a9-410c-b9c1-6fe18436ea36 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:31.558879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc6a92-70a9-410c-b9c1-6fe18436ea36 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:31.560387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 183/354] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:31.566268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f356-23af-4481-9bf0-c975268d1699 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:31.566585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f356-23af-4481-9bf0-c975268d1699 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:31.566812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f356-23af-4481-9bf0-c975268d1699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:31.589736 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7695f356-23af-4481-9bf0-c975268d1699 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:31.591750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7695f356-23af-4481-9bf0-c975268d1699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:31.604370 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29c2d4-7935-45e0-b4b9-69d1f68743fe None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:31.633785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:31.656905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b6abe-b93d-450c-a0f1-5983a2d52191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:31.658547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b6abe-b93d-450c-a0f1-5983a2d52191 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:31.659048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b6abe-b93d-450c-a0f1-5983a2d52191 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:31.659681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b6abe-b93d-450c-a0f1-5983a2d52191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:31.675366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 184/355] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:31.676027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b6abe-b93d-450c-a0f1-5983a2d52191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:31.677832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b6abe-b93d-450c-a0f1-5983a2d52191 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-4e2b6abe-b93d-450c-a0f1-5983a2d52191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:31.693837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:31.694857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:31.695779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:31.695779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:31.695779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:31.697681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 172/356] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:31.704060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f356-23af-4481-9bf0-c975268d1699 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:31.773856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:31.820556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f356-23af-4481-9bf0-c975268d1699 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:31.857433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5f849-fda2-433c-bc2f-9735530734cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:31.858369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5f849-fda2-433c-bc2f-9735530734cf None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:31.858862 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5f849-fda2-433c-bc2f-9735530734cf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:31.859334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5f849-fda2-433c-bc2f-9735530734cf None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:31.860185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5f849-fda2-433c-bc2f-9735530734cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:31.860679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5f849-fda2-433c-bc2f-9735530734cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:31.862271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5f849-fda2-433c-bc2f-9735530734cf None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:31.876130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 185/357] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:31.881337 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b6abe-b93d-450c-a0f1-5983a2d52191 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:32.027018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b6abe-b93d-450c-a0f1-5983a2d52191 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:32.035114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5f849-fda2-433c-bc2f-9735530734cf None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:32.099241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb674e-af65-4ccd-8e9e-3992213662a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:32.099969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb674e-af65-4ccd-8e9e-3992213662a9 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:32.100247 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb674e-af65-4ccd-8e9e-3992213662a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:32.100514 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb674e-af65-4ccd-8e9e-3992213662a9 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:32.101439 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb674e-af65-4ccd-8e9e-3992213662a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:32.102860 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb674e-af65-4ccd-8e9e-3992213662a9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:32.135881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 173/358] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:14:31 2022] POST /identity/v3/users => generated 249 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:14:32.158081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5f849-fda2-433c-bc2f-9735530734cf None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:32.181109 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:32.197642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1806a54-3186-47d9-a26d-a7aa455ce18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:32.198254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806a54-3186-47d9-a26d-a7aa455ce18b None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:32.198526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806a54-3186-47d9-a26d-a7aa455ce18b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:32.198794 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806a54-3186-47d9-a26d-a7aa455ce18b None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:32.199459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1806a54-3186-47d9-a26d-a7aa455ce18b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:32.200819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1806a54-3186-47d9-a26d-a7aa455ce18b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:32.209199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.sql.core [None req-b1806a54-3186-47d9-a26d-a7aa455ce18b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:14:32.209199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 07:14:32.209199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [parameters: {'id': 'a8088b3150b24e139bb1559bf98b56a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 07:14:32.209199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81559) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-b1806a54-3186-47d9-a26d-a7aa455ce18b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result.read() Nov 02 07:14:32.227534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return ref.to_dict() Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:14:32.228472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application yield resource Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise self.value Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application session.commit() Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:14:32.229425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:14:32.230244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:14:32.231101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result.read() Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:14:32.231934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [parameters: {'id': 'a8088b3150b24e139bb1559bf98b56a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:32.232707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 07:14:32.235404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:32.242210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 186/359] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Nov 2 07:14:32 2022] POST /identity/v3/roles => generated 144 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:32.242424 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb674e-af65-4ccd-8e9e-3992213662a9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:32.279904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:32.388680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb674e-af65-4ccd-8e9e-3992213662a9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:32.432426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45630558-4183-49b5-af9b-0b7cf1caaa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:32.433147 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630558-4183-49b5-af9b-0b7cf1caaa6a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:32.433428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630558-4183-49b5-af9b-0b7cf1caaa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:32.433696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630558-4183-49b5-af9b-0b7cf1caaa6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:32.450342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45630558-4183-49b5-af9b-0b7cf1caaa6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-45630558-4183-49b5-af9b-0b7cf1caaa6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:32.455758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:32.457823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:14:32.459808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:32.461385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 174/360] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:14:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:32.465104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1806a54-3186-47d9-a26d-a7aa455ce18b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:32.573820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1806a54-3186-47d9-a26d-a7aa455ce18b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:32.611756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c29e5-7121-43b5-9451-9b2e67e1344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:32.612363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c29e5-7121-43b5-9451-9b2e67e1344f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:32.612637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c29e5-7121-43b5-9451-9b2e67e1344f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:32.612907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c29e5-7121-43b5-9451-9b2e67e1344f None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:32.613602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c29e5-7121-43b5-9451-9b2e67e1344f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:32.613900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c29e5-7121-43b5-9451-9b2e67e1344f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:32.615276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c29e5-7121-43b5-9451-9b2e67e1344f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:32.624906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 187/361] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:33.853706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4377e-b945-4f2f-9055-3ddea4c3ec6a None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:33.854420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4377e-b945-4f2f-9055-3ddea4c3ec6a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:33.854420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4377e-b945-4f2f-9055-3ddea4c3ec6a None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:33.855946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 175/362] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:33.860584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f9cc-0522-489d-9b48-77e026a0b151 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:33.861059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f9cc-0522-489d-9b48-77e026a0b151 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:33.861228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61f9cc-0522-489d-9b48-77e026a0b151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:33.885258 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-eb61f9cc-0522-489d-9b48-77e026a0b151 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:33.886458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-eb61f9cc-0522-489d-9b48-77e026a0b151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:33.957727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:33.999059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 188/363] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:34.097844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ebc9e-7300-4b36-b445-b7830c7b5e7c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:34.098165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ebc9e-7300-4b36-b445-b7830c7b5e7c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:34.098391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ebc9e-7300-4b36-b445-b7830c7b5e7c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:34.099724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 176/364] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:34.105170 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc90215-9d75-4840-a9ae-161e81efe40d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:34.105397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc90215-9d75-4840-a9ae-161e81efe40d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:34.105667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc90215-9d75-4840-a9ae-161e81efe40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:34.124568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6bc90215-9d75-4840-a9ae-161e81efe40d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:34.125775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6bc90215-9d75-4840-a9ae-161e81efe40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:34.201124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 189/365] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:34.367048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ebc9e-7300-4b36-b445-b7830c7b5e7c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:34.479263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:34.499724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ebc9e-7300-4b36-b445-b7830c7b5e7c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:34.516665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc90215-9d75-4840-a9ae-161e81efe40d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:34.548687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0268a81-0f5c-43e3-91ad-cd4701244f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:34.549357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268a81-0f5c-43e3-91ad-cd4701244f2a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:34.549632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268a81-0f5c-43e3-91ad-cd4701244f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:34.549897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268a81-0f5c-43e3-91ad-cd4701244f2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:34.568653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0268a81-0f5c-43e3-91ad-cd4701244f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d0268a81-0f5c-43e3-91ad-cd4701244f2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:34.574188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:34.575089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:34.576302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 177/366] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:34.580914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0268a81-0f5c-43e3-91ad-cd4701244f2a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:34.633789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc90215-9d75-4840-a9ae-161e81efe40d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:34.642397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:34.673399 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193ea22-450a-4539-a9aa-61752de8e50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:34.674032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ea22-450a-4539-a9aa-61752de8e50f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:34.674477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ea22-450a-4539-a9aa-61752de8e50f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:34.674747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ea22-450a-4539-a9aa-61752de8e50f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:34.687423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193ea22-450a-4539-a9aa-61752de8e50f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-5193ea22-450a-4539-a9aa-61752de8e50f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:34.692734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:34.693847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 190/367] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:34.699570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965e528-6969-42ab-b86b-2a211ac0300d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:34.700341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965e528-6969-42ab-b86b-2a211ac0300d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:34.700341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965e528-6969-42ab-b86b-2a211ac0300d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:34.700341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 191/368] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:34.700341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965e528-6969-42ab-b86b-2a211ac0300d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:34.725053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0268a81-0f5c-43e3-91ad-cd4701244f2a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:34.772106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1892c0-31ba-477b-818a-9a60903c7338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:34.773854 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1892c0-31ba-477b-818a-9a60903c7338 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:34.774533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1892c0-31ba-477b-818a-9a60903c7338 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:34.774956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1892c0-31ba-477b-818a-9a60903c7338 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:34.775753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1892c0-31ba-477b-818a-9a60903c7338 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:34.776199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1892c0-31ba-477b-818a-9a60903c7338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:34.778568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1892c0-31ba-477b-818a-9a60903c7338 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:34.793716 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 178/369] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:34.794430 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdf6cb-556f-4c72-8461-5af3be6395f2 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:34.794776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdf6cb-556f-4c72-8461-5af3be6395f2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:34.795044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdf6cb-556f-4c72-8461-5af3be6395f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:34.813509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e9fdf6cb-556f-4c72-8461-5af3be6395f2 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:34.814635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e9fdf6cb-556f-4c72-8461-5af3be6395f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:34.817447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:34.825355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965e528-6969-42ab-b86b-2a211ac0300d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:34.863907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868fdce-2295-48e9-b6cb-a2707caa8b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:34.865440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868fdce-2295-48e9-b6cb-a2707caa8b78 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:34.865942 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868fdce-2295-48e9-b6cb-a2707caa8b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:34.866403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868fdce-2295-48e9-b6cb-a2707caa8b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:34.867383 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868fdce-2295-48e9-b6cb-a2707caa8b78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:34.867896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868fdce-2295-48e9-b6cb-a2707caa8b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:34.869525 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868fdce-2295-48e9-b6cb-a2707caa8b78 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:34.884208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 192/370] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:34.885487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868fdce-2295-48e9-b6cb-a2707caa8b78 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:34.892321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 179/371] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:34.892321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdf6cb-556f-4c72-8461-5af3be6395f2 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:34.940153 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:35.015477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdf6cb-556f-4c72-8461-5af3be6395f2 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:35.066941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a5575-1b66-42fc-a5a6-0cc88326d869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:35.067574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a5575-1b66-42fc-a5a6-0cc88326d869 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.067680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868fdce-2295-48e9-b6cb-a2707caa8b78 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:35.067860 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a5575-1b66-42fc-a5a6-0cc88326d869 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.068105 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a5575-1b66-42fc-a5a6-0cc88326d869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.078890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:35.081273 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a5575-1b66-42fc-a5a6-0cc88326d869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:35.082781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a5575-1b66-42fc-a5a6-0cc88326d869 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-337a5575-1b66-42fc-a5a6-0cc88326d869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:35.099341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:35.100258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:35.101734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:35.101734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:35.101734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:35.101734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 180/372] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:35.102622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e1174-0e71-4068-ba42-11595aa1909f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.103718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e1174-0e71-4068-ba42-11595aa1909f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.103718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e1174-0e71-4068-ba42-11595aa1909f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.107588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 181/373] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:35.108672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e1174-0e71-4068-ba42-11595aa1909f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:35.114760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2910b-433d-4373-9162-dd52c28e86ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:35.115403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2910b-433d-4373-9162-dd52c28e86ec None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.115678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2910b-433d-4373-9162-dd52c28e86ec None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.121068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2910b-433d-4373-9162-dd52c28e86ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.130221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2910b-433d-4373-9162-dd52c28e86ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:35.132015 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2910b-433d-4373-9162-dd52c28e86ec None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0dd2910b-433d-4373-9162-dd52c28e86ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:35.151598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:35.153760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:35.155327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:35.155327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:35.155327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:35.155327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 193/374] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:35.155327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d29b0-a31f-4604-93e8-6e8e871bfe48 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.155327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d29b0-a31f-4604-93e8-6e8e871bfe48 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.155327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d29b0-a31f-4604-93e8-6e8e871bfe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.176362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0b4d29b0-a31f-4604-93e8-6e8e871bfe48 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:35.177870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0b4d29b0-a31f-4604-93e8-6e8e871bfe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:35.236436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e1174-0e71-4068-ba42-11595aa1909f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:35.252594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 194/375] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:35.261424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d29b0-a31f-4604-93e8-6e8e871bfe48 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:35.275884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:35.288659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f63e7b-f64d-4bea-ad65-bf1fc6beca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:35.289338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f63e7b-f64d-4bea-ad65-bf1fc6beca70 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.289640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f63e7b-f64d-4bea-ad65-bf1fc6beca70 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.290420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f63e7b-f64d-4bea-ad65-bf1fc6beca70 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.291069 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f63e7b-f64d-4bea-ad65-bf1fc6beca70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:35.291368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f63e7b-f64d-4bea-ad65-bf1fc6beca70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:35.292986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f63e7b-f64d-4bea-ad65-bf1fc6beca70 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:35.314005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 182/376] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:35.314005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f63e7b-f64d-4bea-ad65-bf1fc6beca70 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:35.381073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d29b0-a31f-4604-93e8-6e8e871bfe48 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:35.384499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:35.422220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe185a2-d805-4739-97f5-33c71fdcb15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:35.423149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe185a2-d805-4739-97f5-33c71fdcb15a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.423638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe185a2-d805-4739-97f5-33c71fdcb15a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.424110 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe185a2-d805-4739-97f5-33c71fdcb15a None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.424951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe185a2-d805-4739-97f5-33c71fdcb15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:35.425478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe185a2-d805-4739-97f5-33c71fdcb15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:35.427118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe185a2-d805-4739-97f5-33c71fdcb15a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:35.444158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 195/377] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:35.445379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe185a2-d805-4739-97f5-33c71fdcb15a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:35.452214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f63e7b-f64d-4bea-ad65-bf1fc6beca70 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:35.498970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572512-1e9d-4e72-8f01-055ed5fc8ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:35.499606 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572512-1e9d-4e72-8f01-055ed5fc8ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.499878 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572512-1e9d-4e72-8f01-055ed5fc8ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.500144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99572512-1e9d-4e72-8f01-055ed5fc8ae5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.511219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99572512-1e9d-4e72-8f01-055ed5fc8ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-99572512-1e9d-4e72-8f01-055ed5fc8ae5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:35.516082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:35.516964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:35.517843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 183/378] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:35.518499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572512-1e9d-4e72-8f01-055ed5fc8ae5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:35.525368 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:35.557707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe185a2-d805-4739-97f5-33c71fdcb15a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:35.590394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cfc3d-7c14-4028-8f73-abff864c030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:35.591020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfc3d-7c14-4028-8f73-abff864c030d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.591299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfc3d-7c14-4028-8f73-abff864c030d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.591821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfc3d-7c14-4028-8f73-abff864c030d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.599113 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cfc3d-7c14-4028-8f73-abff864c030d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:35.600550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cfc3d-7c14-4028-8f73-abff864c030d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-f90cfc3d-7c14-4028-8f73-abff864c030d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:35.613468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:35.614418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:35.615324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 196/379] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:35.615909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7d91-063a-426d-97d2-9d8325f0ac6e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.616110 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7d91-063a-426d-97d2-9d8325f0ac6e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.616404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7d91-063a-426d-97d2-9d8325f0ac6e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.617766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 197/380] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:35.618447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7d91-063a-426d-97d2-9d8325f0ac6e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:35.623914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99572512-1e9d-4e72-8f01-055ed5fc8ae5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:35.637574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:35.658915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae13a99-66b1-48c6-8221-14790379e6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:35.659548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae13a99-66b1-48c6-8221-14790379e6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.659821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae13a99-66b1-48c6-8221-14790379e6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.660090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae13a99-66b1-48c6-8221-14790379e6e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.667282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae13a99-66b1-48c6-8221-14790379e6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:35.668728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae13a99-66b1-48c6-8221-14790379e6e4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1ae13a99-66b1-48c6-8221-14790379e6e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:35.681717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:35.682736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 184/381] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 07:14:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:35.683627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae13a99-66b1-48c6-8221-14790379e6e4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:35.721816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7d91-063a-426d-97d2-9d8325f0ac6e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:35.748747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:35.754523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f62473-9e04-49d4-a53f-6865fbdea027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:35.755116 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f62473-9e04-49d4-a53f-6865fbdea027 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.755385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f62473-9e04-49d4-a53f-6865fbdea027 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.755649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f62473-9e04-49d4-a53f-6865fbdea027 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.756302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f62473-9e04-49d4-a53f-6865fbdea027 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:35.756593 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f62473-9e04-49d4-a53f-6865fbdea027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:35.758485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f62473-9e04-49d4-a53f-6865fbdea027 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:35.766620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 198/382] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:35.767391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f62473-9e04-49d4-a53f-6865fbdea027 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:35.788978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae13a99-66b1-48c6-8221-14790379e6e4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:35.822525 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c1dc-aa46-4b3e-83f2-50c286da76d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:35.823155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c1dc-aa46-4b3e-83f2-50c286da76d7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.823429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c1dc-aa46-4b3e-83f2-50c286da76d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.823700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c1dc-aa46-4b3e-83f2-50c286da76d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.834236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7c1dc-aa46-4b3e-83f2-50c286da76d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-f5f7c1dc-aa46-4b3e-83f2-50c286da76d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:35.840292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:35.841256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:35.842309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 185/383] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:35.842999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a122930-50bf-4d36-bda8-8c61f7fc205a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.843066 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a122930-50bf-4d36-bda8-8c61f7fc205a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.843646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a122930-50bf-4d36-bda8-8c61f7fc205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.860698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9a122930-50bf-4d36-bda8-8c61f7fc205a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:35.861921 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9a122930-50bf-4d36-bda8-8c61f7fc205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:35.867393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f62473-9e04-49d4-a53f-6865fbdea027 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:35.887929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:35.901582 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527e266-943f-4ed3-9a74-278f3b9df263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:35.902189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527e266-943f-4ed3-9a74-278f3b9df263 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:35.902464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527e266-943f-4ed3-9a74-278f3b9df263 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:35.902735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527e266-943f-4ed3-9a74-278f3b9df263 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:35.903487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527e266-943f-4ed3-9a74-278f3b9df263 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:35.903790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527e266-943f-4ed3-9a74-278f3b9df263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:35.905243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527e266-943f-4ed3-9a74-278f3b9df263 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:35.929913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 186/384] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:35.931119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a122930-50bf-4d36-bda8-8c61f7fc205a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:35.942516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 199/385] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 2 07:14:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:35.943478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527e266-943f-4ed3-9a74-278f3b9df263 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.002270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:36.046092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a122930-50bf-4d36-bda8-8c61f7fc205a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.055927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527e266-943f-4ed3-9a74-278f3b9df263 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.083319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fce33-b824-4068-ae1c-6e7a9ca4fd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.083920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fce33-b824-4068-ae1c-6e7a9ca4fd1f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.084191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fce33-b824-4068-ae1c-6e7a9ca4fd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.084457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fce33-b824-4068-ae1c-6e7a9ca4fd1f None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.085206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fce33-b824-4068-ae1c-6e7a9ca4fd1f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:36.086057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fce33-b824-4068-ae1c-6e7a9ca4fd1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.087473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fce33-b824-4068-ae1c-6e7a9ca4fd1f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.091851 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568a428-1f7c-43ec-a5d1-21ef60abb169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.092629 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568a428-1f7c-43ec-a5d1-21ef60abb169 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.093096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568a428-1f7c-43ec-a5d1-21ef60abb169 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.093514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568a428-1f7c-43ec-a5d1-21ef60abb169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.105071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568a428-1f7c-43ec-a5d1-21ef60abb169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.106666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568a428-1f7c-43ec-a5d1-21ef60abb169 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-7568a428-1f7c-43ec-a5d1-21ef60abb169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:36.122167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:36.123249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:36.124193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:36.124193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:36.124193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:36.124351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 187/386] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 07:14:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:36.124619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fce33-b824-4068-ae1c-6e7a9ca4fd1f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.126131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 200/387] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:36.127051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568a428-1f7c-43ec-a5d1-21ef60abb169 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.151734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:36.231562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568a428-1f7c-43ec-a5d1-21ef60abb169 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.233022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:36.234760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fce33-b824-4068-ae1c-6e7a9ca4fd1f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.266446 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511ee68-621b-4b66-9e8b-878b4bda3ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.267049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511ee68-621b-4b66-9e8b-878b4bda3ebb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.267318 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511ee68-621b-4b66-9e8b-878b4bda3ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.267584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511ee68-621b-4b66-9e8b-878b4bda3ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.273258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a8e1c-9485-4f2e-bae0-654b1f0b0131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.274298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8e1c-9485-4f2e-bae0-654b1f0b0131 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.274602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8e1c-9485-4f2e-bae0-654b1f0b0131 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.274939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8e1c-9485-4f2e-bae0-654b1f0b0131 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.275837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a8e1c-9485-4f2e-bae0-654b1f0b0131 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:36.276143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a8e1c-9485-4f2e-bae0-654b1f0b0131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.277565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a8e1c-9485-4f2e-bae0-654b1f0b0131 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.278088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511ee68-621b-4b66-9e8b-878b4bda3ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.279516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511ee68-621b-4b66-9e8b-878b4bda3ebb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.285623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 188/388] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:36.286412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a8e1c-9485-4f2e-bae0-654b1f0b0131 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9511ee68-621b-4b66-9e8b-878b4bda3ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:36.294187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:36.295226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:36.296052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:36.296052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:36.296052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:36.296052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 201/389] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:36.296052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511ee68-621b-4b66-9e8b-878b4bda3ebb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.372170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:36.391102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a8e1c-9485-4f2e-bae0-654b1f0b0131 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.397300 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511ee68-621b-4b66-9e8b-878b4bda3ebb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.424427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f011e76-40cf-435e-8e82-1003ddb2a060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.425168 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011e76-40cf-435e-8e82-1003ddb2a060 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.425454 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011e76-40cf-435e-8e82-1003ddb2a060 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.425722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f011e76-40cf-435e-8e82-1003ddb2a060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.431422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d03985-f039-48ef-800b-69791bb5db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.432019 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d03985-f039-48ef-800b-69791bb5db83 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.432298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d03985-f039-48ef-800b-69791bb5db83 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.432994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d03985-f039-48ef-800b-69791bb5db83 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.433667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d03985-f039-48ef-800b-69791bb5db83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:36.433972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d03985-f039-48ef-800b-69791bb5db83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.435745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d03985-f039-48ef-800b-69791bb5db83 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.436195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f011e76-40cf-435e-8e82-1003ddb2a060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.437663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f011e76-40cf-435e-8e82-1003ddb2a060 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.450311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 202/390] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:36.451105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d03985-f039-48ef-800b-69791bb5db83 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1f011e76-40cf-435e-8e82-1003ddb2a060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:36.452144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:36.453045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:36.453869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:36.453869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:36.453869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:36.453869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 189/391] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:36.454088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f011e76-40cf-435e-8e82-1003ddb2a060 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.469498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:36.552963 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d03985-f039-48ef-800b-69791bb5db83 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.555057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f011e76-40cf-435e-8e82-1003ddb2a060 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.586897 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60f59f-4c38-4f37-84ac-4eceefaf5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.587519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f59f-4c38-4f37-84ac-4eceefaf5690 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.587797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f59f-4c38-4f37-84ac-4eceefaf5690 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.588067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f59f-4c38-4f37-84ac-4eceefaf5690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.588536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c59a7-272a-4aac-9a24-be12f7ec8b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.589177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c59a7-272a-4aac-9a24-be12f7ec8b2f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.589451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c59a7-272a-4aac-9a24-be12f7ec8b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.589715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c59a7-272a-4aac-9a24-be12f7ec8b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.591808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:36.598828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60f59f-4c38-4f37-84ac-4eceefaf5690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.600284 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60f59f-4c38-4f37-84ac-4eceefaf5690 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.601813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c59a7-272a-4aac-9a24-be12f7ec8b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.603423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c59a7-272a-4aac-9a24-be12f7ec8b2f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-bc60f59f-4c38-4f37-84ac-4eceefaf5690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:36.615437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:36.616344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:36.617812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:36.617812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:36.617812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:36.617812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 203/392] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-2c2c59a7-272a-4aac-9a24-be12f7ec8b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:36.618044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:36.618826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:36.620526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:36.620526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:36.620526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:36.620800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60f59f-4c38-4f37-84ac-4eceefaf5690 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.620921 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 190/393] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:36.620921 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c59a7-272a-4aac-9a24-be12f7ec8b2f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.686272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:36.719687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c59a7-272a-4aac-9a24-be12f7ec8b2f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.721644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60f59f-4c38-4f37-84ac-4eceefaf5690 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.754049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d4b6d-e5c6-41fe-a9c1-496299d09915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.754245 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76c822-9d84-4fbc-a3e2-603a05c2886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.754668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d4b6d-e5c6-41fe-a9c1-496299d09915 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.754775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76c822-9d84-4fbc-a3e2-603a05c2886c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.754940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76c822-9d84-4fbc-a3e2-603a05c2886c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.755049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d4b6d-e5c6-41fe-a9c1-496299d09915 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.755205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76c822-9d84-4fbc-a3e2-603a05c2886c None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.755294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d4b6d-e5c6-41fe-a9c1-496299d09915 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.755825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76c822-9d84-4fbc-a3e2-603a05c2886c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:36.756121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76c822-9d84-4fbc-a3e2-603a05c2886c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.757546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76c822-9d84-4fbc-a3e2-603a05c2886c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.763068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d4b6d-e5c6-41fe-a9c1-496299d09915 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.764515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d4b6d-e5c6-41fe-a9c1-496299d09915 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.768815 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 204/394] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:36.769619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76c822-9d84-4fbc-a3e2-603a05c2886c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-ff3d4b6d-e5c6-41fe-a9c1-496299d09915 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:36.776404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:36.777322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 191/395] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:36.778286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d4b6d-e5c6-41fe-a9c1-496299d09915 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.823689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:36.875790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76c822-9d84-4fbc-a3e2-603a05c2886c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.877823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d4b6d-e5c6-41fe-a9c1-496299d09915 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:36.904016 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:36.914640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469be16-eb09-4ec9-acd4-db766b49a8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.915244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469be16-eb09-4ec9-acd4-db766b49a8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.915519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469be16-eb09-4ec9-acd4-db766b49a8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.915783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469be16-eb09-4ec9-acd4-db766b49a8a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.916086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5945c99-146b-489c-bec0-600d9d5e8228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:36.916413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469be16-eb09-4ec9-acd4-db766b49a8a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:36.916689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5945c99-146b-489c-bec0-600d9d5e8228 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:36.916790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469be16-eb09-4ec9-acd4-db766b49a8a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.916965 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5945c99-146b-489c-bec0-600d9d5e8228 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:36.917269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5945c99-146b-489c-bec0-600d9d5e8228 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:36.917904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5945c99-146b-489c-bec0-600d9d5e8228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:36.918112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469be16-eb09-4ec9-acd4-db766b49a8a4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.918235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5945c99-146b-489c-bec0-600d9d5e8228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:36.919545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5945c99-146b-489c-bec0-600d9d5e8228 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:36.933048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 205/396] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:36.933048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469be16-eb09-4ec9-acd4-db766b49a8a4 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:36.939495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 192/397] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:36.939495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5945c99-146b-489c-bec0-600d9d5e8228 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.028175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469be16-eb09-4ec9-acd4-db766b49a8a4 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.037705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5945c99-146b-489c-bec0-600d9d5e8228 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.045032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:37.062990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237086e-b35b-4ea1-8945-f41bca418b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.063589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237086e-b35b-4ea1-8945-f41bca418b90 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.063863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237086e-b35b-4ea1-8945-f41bca418b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.064129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237086e-b35b-4ea1-8945-f41bca418b90 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.064759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237086e-b35b-4ea1-8945-f41bca418b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:37.065086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237086e-b35b-4ea1-8945-f41bca418b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.066451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237086e-b35b-4ea1-8945-f41bca418b90 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.072890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbea57-7c92-4bca-8ed3-22a99a44b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.073532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbea57-7c92-4bca-8ed3-22a99a44b6bb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.073852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbea57-7c92-4bca-8ed3-22a99a44b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.074071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbea57-7c92-4bca-8ed3-22a99a44b6bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.077955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 206/398] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:37.078739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237086e-b35b-4ea1-8945-f41bca418b90 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.080569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbea57-7c92-4bca-8ed3-22a99a44b6bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.082026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbea57-7c92-4bca-8ed3-22a99a44b6bb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5afbea57-7c92-4bca-8ed3-22a99a44b6bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:37.094565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:37.095623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:37.096747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:37.096747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:37.096747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:37.096747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:37.096747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:37.096747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:37.096747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:37.096747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:37.096747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 193/399] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:37.096747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbea57-7c92-4bca-8ed3-22a99a44b6bb None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.130635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:37.183322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237086e-b35b-4ea1-8945-f41bca418b90 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.194414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbea57-7c92-4bca-8ed3-22a99a44b6bb None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.217474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e940520-bcd4-4141-987c-b7c9427f932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.218118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e940520-bcd4-4141-987c-b7c9427f932b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.218389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e940520-bcd4-4141-987c-b7c9427f932b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.218650 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e940520-bcd4-4141-987c-b7c9427f932b None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.219364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e940520-bcd4-4141-987c-b7c9427f932b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:37.219660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e940520-bcd4-4141-987c-b7c9427f932b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.221117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e940520-bcd4-4141-987c-b7c9427f932b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.228160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d95ed-d844-49e7-909f-b714bf0698d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.228779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d95ed-d844-49e7-909f-b714bf0698d6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.229088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d95ed-d844-49e7-909f-b714bf0698d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.229360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d95ed-d844-49e7-909f-b714bf0698d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.235849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d95ed-d844-49e7-909f-b714bf0698d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.237304 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d95ed-d844-49e7-909f-b714bf0698d6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.238418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 207/400] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 2 07:14:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:37.239215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e940520-bcd4-4141-987c-b7c9427f932b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-222d95ed-d844-49e7-909f-b714bf0698d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:37.249509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:37.250527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:37.251388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:37.251388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:37.251388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:37.251388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:37.251388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:37.251388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:37.251388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:37.251388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:37.251388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 194/401] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:37.251835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d95ed-d844-49e7-909f-b714bf0698d6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.282223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:37.340551 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e940520-bcd4-4141-987c-b7c9427f932b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.343013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:37.353907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d95ed-d844-49e7-909f-b714bf0698d6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.374903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763401a-0bdb-43f3-9b15-ffd1351b2b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.375517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763401a-0bdb-43f3-9b15-ffd1351b2b1a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.375793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763401a-0bdb-43f3-9b15-ffd1351b2b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.376065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763401a-0bdb-43f3-9b15-ffd1351b2b1a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.383433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763401a-0bdb-43f3-9b15-ffd1351b2b1a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.384870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763401a-0bdb-43f3-9b15-ffd1351b2b1a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.386934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380682c-2bd2-46f9-935d-dca1e54802c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.387534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380682c-2bd2-46f9-935d-dca1e54802c3 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.387805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380682c-2bd2-46f9-935d-dca1e54802c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.388072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380682c-2bd2-46f9-935d-dca1e54802c3 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.388705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380682c-2bd2-46f9-935d-dca1e54802c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.390181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380682c-2bd2-46f9-935d-dca1e54802c3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-6763401a-0bdb-43f3-9b15-ffd1351b2b1a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:37.396181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:37.397337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 208/402] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:37.398344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763401a-0bdb-43f3-9b15-ffd1351b2b1a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.415625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 195/403] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:14:37 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:37.416442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380682c-2bd2-46f9-935d-dca1e54802c3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.511714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:37.516287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763401a-0bdb-43f3-9b15-ffd1351b2b1a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.534597 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380682c-2bd2-46f9-935d-dca1e54802c3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.558257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc53e8d-e135-431a-b3b3-daaa40e0efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.559042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc53e8d-e135-431a-b3b3-daaa40e0efa9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.559328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc53e8d-e135-431a-b3b3-daaa40e0efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.559605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc53e8d-e135-431a-b3b3-daaa40e0efa9 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.560432 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc53e8d-e135-431a-b3b3-daaa40e0efa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:37.560861 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc53e8d-e135-431a-b3b3-daaa40e0efa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.562350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc53e8d-e135-431a-b3b3-daaa40e0efa9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.571606 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b56fd-d467-4b66-93f9-f449b8062918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.572255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b56fd-d467-4b66-93f9-f449b8062918 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.572529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b56fd-d467-4b66-93f9-f449b8062918 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.572851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b56fd-d467-4b66-93f9-f449b8062918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.585297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 209/404] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:37.586061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b56fd-d467-4b66-93f9-f449b8062918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.591131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc53e8d-e135-431a-b3b3-daaa40e0efa9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.591270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b56fd-d467-4b66-93f9-f449b8062918 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-ed2b56fd-d467-4b66-93f9-f449b8062918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:37.605248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:37.606205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:37.607040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:37.607040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:37.607040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:37.607040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 196/405] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:37.607671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b56fd-d467-4b66-93f9-f449b8062918 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.620929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:37.702428 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc53e8d-e135-431a-b3b3-daaa40e0efa9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.718090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b56fd-d467-4b66-93f9-f449b8062918 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.744321 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ab723-0412-4f10-9a94-545e4afc4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.745287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab723-0412-4f10-9a94-545e4afc4262 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.745726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab723-0412-4f10-9a94-545e4afc4262 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.746000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab723-0412-4f10-9a94-545e4afc4262 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.746699 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ab723-0412-4f10-9a94-545e4afc4262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:37.747153 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ab723-0412-4f10-9a94-545e4afc4262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.748925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ab723-0412-4f10-9a94-545e4afc4262 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.752788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffacab3-5654-4651-bb11-8ccb2ac18212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.753416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffacab3-5654-4651-bb11-8ccb2ac18212 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.753688 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffacab3-5654-4651-bb11-8ccb2ac18212 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.753951 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffacab3-5654-4651-bb11-8ccb2ac18212 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.754674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffacab3-5654-4651-bb11-8ccb2ac18212 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:37.754974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffacab3-5654-4651-bb11-8ccb2ac18212 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.756846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffacab3-5654-4651-bb11-8ccb2ac18212 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.759319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:37.761350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 210/406] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:37.761947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ab723-0412-4f10-9a94-545e4afc4262 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.782463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 197/407] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Nov 2 07:14:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:37.787521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffacab3-5654-4651-bb11-8ccb2ac18212 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.852345 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:37.872852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ab723-0412-4f10-9a94-545e4afc4262 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.892270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffacab3-5654-4651-bb11-8ccb2ac18212 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:37.916148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a854afc-f7fd-4bcd-9b28-0b9f484c7761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.916913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a854afc-f7fd-4bcd-9b28-0b9f484c7761 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.917243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a854afc-f7fd-4bcd-9b28-0b9f484c7761 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.917514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a854afc-f7fd-4bcd-9b28-0b9f484c7761 None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/c27a93c04181493593a069650a977773/roles/f6ee9e8014884bc5aff06380618f6aa2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.931252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c472c-cded-495c-a6da-05e0ffae7d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:37.931859 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c472c-cded-495c-a6da-05e0ffae7d91 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:37.932134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c472c-cded-495c-a6da-05e0ffae7d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:37.932405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c472c-cded-495c-a6da-05e0ffae7d91 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:37.933074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c472c-cded-495c-a6da-05e0ffae7d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:37.933380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c472c-cded-495c-a6da-05e0ffae7d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.933555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a854afc-f7fd-4bcd-9b28-0b9f484c7761 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=c27a93c04181493593a069650a977773, role_id=f6ee9e8014884bc5aff06380618f6aa2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:37.934738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c472c-cded-495c-a6da-05e0ffae7d91 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.934975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a854afc-f7fd-4bcd-9b28-0b9f484c7761 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:37.947880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 198/408] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:37.948682 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c472c-cded-495c-a6da-05e0ffae7d91 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:37.949605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 211/409] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:14:37 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/c27a93c04181493593a069650a977773/roles/f6ee9e8014884bc5aff06380618f6aa2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:37.950625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a854afc-f7fd-4bcd-9b28-0b9f484c7761 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:38.024284 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:38.080307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c472c-cded-495c-a6da-05e0ffae7d91 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:38.092956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a854afc-f7fd-4bcd-9b28-0b9f484c7761 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:38.120784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c9640-db98-4ecd-a390-939c2d872935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:38.121870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c9640-db98-4ecd-a390-939c2d872935 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:38.123273 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c9640-db98-4ecd-a390-939c2d872935 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:38.123743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c9640-db98-4ecd-a390-939c2d872935 None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/ad0826bb58db4100b0d807fb07734deb/roles/f6ee9e8014884bc5aff06380618f6aa2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:38.139647 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ab9b0-9527-4cf4-ab70-654c17c977b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:38.140078 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ab9b0-9527-4cf4-ab70-654c17c977b6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:38.140357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ab9b0-9527-4cf4-ab70-654c17c977b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:38.140627 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ab9b0-9527-4cf4-ab70-654c17c977b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:38.142477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c9640-db98-4ecd-a390-939c2d872935 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=ad0826bb58db4100b0d807fb07734deb, role_id=f6ee9e8014884bc5aff06380618f6aa2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:38.142900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:38.144452 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c9640-db98-4ecd-a390-939c2d872935 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:38.155171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ab9b0-9527-4cf4-ab70-654c17c977b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:38.156884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ab9b0-9527-4cf4-ab70-654c17c977b6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:38.161040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 199/410] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:14:37 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/ad0826bb58db4100b0d807fb07734deb/roles/f6ee9e8014884bc5aff06380618f6aa2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:38.163133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c9640-db98-4ecd-a390-939c2d872935 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-fd9ab9b0-9527-4cf4-ab70-654c17c977b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:38.174227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:38.175235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:38.176061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:38.176061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:38.176061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:38.176061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 212/411] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:38.181473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ab9b0-9527-4cf4-ab70-654c17c977b6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:38.303536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c9640-db98-4ecd-a390-939c2d872935 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:38.306762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:38.318685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ab9b0-9527-4cf4-ab70-654c17c977b6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:38.347133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f4c49-59f4-4251-a1f0-a1ba19dc89e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:38.347791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f4c49-59f4-4251-a1f0-a1ba19dc89e9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:38.348068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f4c49-59f4-4251-a1f0-a1ba19dc89e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:38.348339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f4c49-59f4-4251-a1f0-a1ba19dc89e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:38.356465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f4c49-59f4-4251-a1f0-a1ba19dc89e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:38.358060 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f4c49-59f4-4251-a1f0-a1ba19dc89e9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:38.368137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932631e5-c6e2-4664-9218-9213b8561df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:38.369156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932631e5-c6e2-4664-9218-9213b8561df3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:38.369634 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932631e5-c6e2-4664-9218-9213b8561df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:38.370118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932631e5-c6e2-4664-9218-9213b8561df3 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:38.371008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932631e5-c6e2-4664-9218-9213b8561df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-813f4c49-59f4-4251-a1f0-a1ba19dc89e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:38.371474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:38.372278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:38.373126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:38.373126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:38.373126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:38.373126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:38.373126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:38.373126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:38.373126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:38.373126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:38.373126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 200/412] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:38.374060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932631e5-c6e2-4664-9218-9213b8561df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:38.376700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932631e5-c6e2-4664-9218-9213b8561df3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:38.378138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f4c49-59f4-4251-a1f0-a1ba19dc89e9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:38.394323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 213/413] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:38.400891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932631e5-c6e2-4664-9218-9213b8561df3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:38.494112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:38.520523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f4c49-59f4-4251-a1f0-a1ba19dc89e9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:38.553175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932631e5-c6e2-4664-9218-9213b8561df3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:38.557210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315268d9-53d1-40a1-9688-c51107cefcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:38.557827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315268d9-53d1-40a1-9688-c51107cefcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:38.558100 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315268d9-53d1-40a1-9688-c51107cefcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:38.558366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315268d9-53d1-40a1-9688-c51107cefcb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:38.559059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315268d9-53d1-40a1-9688-c51107cefcb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:38.559360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315268d9-53d1-40a1-9688-c51107cefcb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:38.560798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315268d9-53d1-40a1-9688-c51107cefcb5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:38.579445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 201/414] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:38.585239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315268d9-53d1-40a1-9688-c51107cefcb5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:38.593287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402668e-1ac5-4fa7-b328-d6424b6ff922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:38.593917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402668e-1ac5-4fa7-b328-d6424b6ff922 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:38.594187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402668e-1ac5-4fa7-b328-d6424b6ff922 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:38.594972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402668e-1ac5-4fa7-b328-d6424b6ff922 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:38.603091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402668e-1ac5-4fa7-b328-d6424b6ff922 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:38.604533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402668e-1ac5-4fa7-b328-d6424b6ff922 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-b402668e-1ac5-4fa7-b328-d6424b6ff922 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:38.617728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:38.618625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:38.619449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:38.619449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:38.619449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:38.619449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:38.619449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:38.619449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:38.619449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:38.619449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:38.619842 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 214/415] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:38.625665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402668e-1ac5-4fa7-b328-d6424b6ff922 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:38.631705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:38.783590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315268d9-53d1-40a1-9688-c51107cefcb5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:38.787456 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402668e-1ac5-4fa7-b328-d6424b6ff922 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:38.800833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:38.852179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18041822-7433-4744-9d13-783b764f7602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:38.852845 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18041822-7433-4744-9d13-783b764f7602 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:38.853143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18041822-7433-4744-9d13-783b764f7602 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:38.853412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18041822-7433-4744-9d13-783b764f7602 None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/2972059254094f8e909eb2adbb0b2257/roles/f6ee9e8014884bc5aff06380618f6aa2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:38.857758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a4af-a0e1-4a29-80a9-200cc72ff463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:38.858374 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a4af-a0e1-4a29-80a9-200cc72ff463 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:38.858647 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a4af-a0e1-4a29-80a9-200cc72ff463 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:38.858913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5a4af-a0e1-4a29-80a9-200cc72ff463 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:38.859921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5a4af-a0e1-4a29-80a9-200cc72ff463 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:38.860227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5a4af-a0e1-4a29-80a9-200cc72ff463 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:38.861686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5a4af-a0e1-4a29-80a9-200cc72ff463 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:38.870881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18041822-7433-4744-9d13-783b764f7602 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=2972059254094f8e909eb2adbb0b2257, role_id=f6ee9e8014884bc5aff06380618f6aa2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:38.872405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18041822-7433-4744-9d13-783b764f7602 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:38.882738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 215/416] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:38.893757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 202/417] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:14:38 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/2972059254094f8e909eb2adbb0b2257/roles/f6ee9e8014884bc5aff06380618f6aa2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:14:38.894086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a4af-a0e1-4a29-80a9-200cc72ff463 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:39.035680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5a4af-a0e1-4a29-80a9-200cc72ff463 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:39.082923 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb6e6a-6d4e-459a-8180-889629c58eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:39.083949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb6e6a-6d4e-459a-8180-889629c58eaf None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:39.084413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb6e6a-6d4e-459a-8180-889629c58eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:39.084859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb6e6a-6d4e-459a-8180-889629c58eaf None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/7f1a24bf15594b12bbf59741fcb46cf9/roles/f6ee9e8014884bc5aff06380618f6aa2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:39.113721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb6e6a-6d4e-459a-8180-889629c58eaf None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=7f1a24bf15594b12bbf59741fcb46cf9, role_id=f6ee9e8014884bc5aff06380618f6aa2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:39.115493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb6e6a-6d4e-459a-8180-889629c58eaf None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:39.132288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 216/418] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:14:38 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/7f1a24bf15594b12bbf59741fcb46cf9/roles/f6ee9e8014884bc5aff06380618f6aa2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:39.896697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72da095-9802-44e4-b6a3-67479315e879 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:39.897242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72da095-9802-44e4-b6a3-67479315e879 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:39.897242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72da095-9802-44e4-b6a3-67479315e879 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:39.899380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 203/419] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:39.907641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edb176-5c92-4458-b9af-96832e778a43 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:39.907641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edb176-5c92-4458-b9af-96832e778a43 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:39.907641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edb176-5c92-4458-b9af-96832e778a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:39.930884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-88edb176-5c92-4458-b9af-96832e778a43 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:39.932070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-88edb176-5c92-4458-b9af-96832e778a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:39.950829 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:40.031566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 217/420] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:40.449635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72da095-9802-44e4-b6a3-67479315e879 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:40.546739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:40.552819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05ccd-e71f-4947-ae7b-e752bce0c579 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:40.553337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05ccd-e71f-4947-ae7b-e752bce0c579 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:40.553413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05ccd-e71f-4947-ae7b-e752bce0c579 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:40.556303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 218/421] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:40.561728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36328006-d2b9-4496-acb3-729ad34f03c6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:40.562031 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36328006-d2b9-4496-acb3-729ad34f03c6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:40.562308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36328006-d2b9-4496-acb3-729ad34f03c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:40.582254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-36328006-d2b9-4496-acb3-729ad34f03c6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:40.583449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-36328006-d2b9-4496-acb3-729ad34f03c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:40.600659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72da095-9802-44e4-b6a3-67479315e879 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:40.647207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f2950-bb71-4d0d-a468-bc752dae62d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:40.647838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f2950-bb71-4d0d-a468-bc752dae62d2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:40.648659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f2950-bb71-4d0d-a468-bc752dae62d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:40.648928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f2950-bb71-4d0d-a468-bc752dae62d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:40.671800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f2950-bb71-4d0d-a468-bc752dae62d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b28f2950-bb71-4d0d-a468-bc752dae62d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:40.676655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:40.677574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:40.678371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:40.678970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 204/422] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:40.689953 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f2950-bb71-4d0d-a468-bc752dae62d2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:40.708937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 219/423] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:40.840696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f2950-bb71-4d0d-a468-bc752dae62d2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:40.879806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:40.889744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabd7d5-4fc0-473b-8b01-60877c769fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:40.890632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabd7d5-4fc0-473b-8b01-60877c769fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:40.891279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabd7d5-4fc0-473b-8b01-60877c769fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:40.891740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabd7d5-4fc0-473b-8b01-60877c769fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:40.892598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabd7d5-4fc0-473b-8b01-60877c769fc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:40.893115 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabd7d5-4fc0-473b-8b01-60877c769fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:40.894674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabd7d5-4fc0-473b-8b01-60877c769fc8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:40.919685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 205/424] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:40.925049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36328006-d2b9-4496-acb3-729ad34f03c6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:41.000064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabd7d5-4fc0-473b-8b01-60877c769fc8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:41.017830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:41.051437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36328006-d2b9-4496-acb3-729ad34f03c6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:41.102609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12f9de-26f3-4ec3-98a5-adc65458b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:41.103276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12f9de-26f3-4ec3-98a5-adc65458b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.103552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12f9de-26f3-4ec3-98a5-adc65458b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.103935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12f9de-26f3-4ec3-98a5-adc65458b8d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.118798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12f9de-26f3-4ec3-98a5-adc65458b8d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:41.120272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12f9de-26f3-4ec3-98a5-adc65458b8d9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0f12f9de-26f3-4ec3-98a5-adc65458b8d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:41.137732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:41.138690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:41.139535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:41.139535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:41.139535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:41.139535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 220/425] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:41.144096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabd7d5-4fc0-473b-8b01-60877c769fc8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:41.144812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940261-8bc5-4d54-b8d4-9aebccbbed4a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.145178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940261-8bc5-4d54-b8d4-9aebccbbed4a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.145463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940261-8bc5-4d54-b8d4-9aebccbbed4a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.148151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 221/426] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:41.148151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940261-8bc5-4d54-b8d4-9aebccbbed4a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:41.181561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15293805-a15f-4c5d-a6e0-4bccab519632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:41.182747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293805-a15f-4c5d-a6e0-4bccab519632 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.183270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293805-a15f-4c5d-a6e0-4bccab519632 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.183734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15293805-a15f-4c5d-a6e0-4bccab519632 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.194416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15293805-a15f-4c5d-a6e0-4bccab519632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-15293805-a15f-4c5d-a6e0-4bccab519632 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:41.200736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:41.201653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:41.202449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:41.205052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 206/427] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:41.206412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d25dc-80b3-4867-ba14-fe5620763eb4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.206884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d25dc-80b3-4867-ba14-fe5620763eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.207342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d25dc-80b3-4867-ba14-fe5620763eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.227228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-768d25dc-80b3-4867-ba14-fe5620763eb4 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:41.228777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-768d25dc-80b3-4867-ba14-fe5620763eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:41.270827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940261-8bc5-4d54-b8d4-9aebccbbed4a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:41.281462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:41.300817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 207/428] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:41.302078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d25dc-80b3-4867-ba14-fe5620763eb4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:41.303683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:41.313966 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089ef38-02f6-42c1-ae1b-7964472c9f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:41.314638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089ef38-02f6-42c1-ae1b-7964472c9f30 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.314915 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089ef38-02f6-42c1-ae1b-7964472c9f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.315184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089ef38-02f6-42c1-ae1b-7964472c9f30 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.315826 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089ef38-02f6-42c1-ae1b-7964472c9f30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:41.316126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089ef38-02f6-42c1-ae1b-7964472c9f30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:41.317712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089ef38-02f6-42c1-ae1b-7964472c9f30 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:41.332153 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 222/429] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:41.339009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089ef38-02f6-42c1-ae1b-7964472c9f30 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:41.410774 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d25dc-80b3-4867-ba14-fe5620763eb4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:41.447954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287878b0-ed68-42ff-bc8b-7636c49df36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:41.448906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287878b0-ed68-42ff-bc8b-7636c49df36a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.449400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287878b0-ed68-42ff-bc8b-7636c49df36a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.449907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287878b0-ed68-42ff-bc8b-7636c49df36a None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.450873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287878b0-ed68-42ff-bc8b-7636c49df36a None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:41.451361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287878b0-ed68-42ff-bc8b-7636c49df36a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:41.452905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287878b0-ed68-42ff-bc8b-7636c49df36a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:41.453363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089ef38-02f6-42c1-ae1b-7964472c9f30 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:41.462852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 208/430] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:41.469959 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287878b0-ed68-42ff-bc8b-7636c49df36a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:41.500743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d48ea-8b71-4888-a222-ee23a5f12fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:41.501740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d48ea-8b71-4888-a222-ee23a5f12fed None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.502221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d48ea-8b71-4888-a222-ee23a5f12fed None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.502694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d48ea-8b71-4888-a222-ee23a5f12fed None admin] PATH_INFO: `/v3/users/swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.511518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d48ea-8b71-4888-a222-ee23a5f12fed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:41.513235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d48ea-8b71-4888-a222-ee23a5f12fed None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-955d48ea-8b71-4888-a222-ee23a5f12fed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:41.527394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:41.528309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:41.529226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:41.529226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:41.529226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:41.529226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:41.529226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:41.529226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:41.529226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:41.529226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:41.529226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:14:41.529226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:41.531772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 223/431] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:14:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:41.537851 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d48ea-8b71-4888-a222-ee23a5f12fed None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:41.576503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:41.596787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:41.655282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d48ea-8b71-4888-a222-ee23a5f12fed None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:41.687544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287878b0-ed68-42ff-bc8b-7636c49df36a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:41.693469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a791e8-80ac-4bbd-81f9-faa37a5e598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:41.694097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a791e8-80ac-4bbd-81f9-faa37a5e598f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.694375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a791e8-80ac-4bbd-81f9-faa37a5e598f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.694645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a791e8-80ac-4bbd-81f9-faa37a5e598f None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.696430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a791e8-80ac-4bbd-81f9-faa37a5e598f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:41.696743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a791e8-80ac-4bbd-81f9-faa37a5e598f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:41.698260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a791e8-80ac-4bbd-81f9-faa37a5e598f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:41.720677 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 224/432] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 07:14:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:41.725566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a791e8-80ac-4bbd-81f9-faa37a5e598f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:41.737532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190eeee-daf8-422b-9c12-1e20a0da99ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:41.738565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190eeee-daf8-422b-9c12-1e20a0da99ec None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.739518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190eeee-daf8-422b-9c12-1e20a0da99ec None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.740099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190eeee-daf8-422b-9c12-1e20a0da99ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.755568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190eeee-daf8-422b-9c12-1e20a0da99ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:41.757062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190eeee-daf8-422b-9c12-1e20a0da99ec None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d190eeee-daf8-422b-9c12-1e20a0da99ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:41.772440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:41.773496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:41.774320 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:41.774320 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:41.774320 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:41.778901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 209/433] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:41.779769 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190eeee-daf8-422b-9c12-1e20a0da99ec None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:41.858461 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a791e8-80ac-4bbd-81f9-faa37a5e598f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:41.866347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:41.888131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:41.891907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190eeee-daf8-422b-9c12-1e20a0da99ec None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:41.897975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b57c19-8ca4-427a-bea0-70c2d930fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:41.899197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b57c19-8ca4-427a-bea0-70c2d930fb38 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.899479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b57c19-8ca4-427a-bea0-70c2d930fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.899754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b57c19-8ca4-427a-bea0-70c2d930fb38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.917686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b57c19-8ca4-427a-bea0-70c2d930fb38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-75b57c19-8ca4-427a-bea0-70c2d930fb38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:41.922718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:41.923588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:41.924375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 225/434] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:41.925757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b57c19-8ca4-427a-bea0-70c2d930fb38 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:41.933328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59e4d8-2627-4d1d-81c6-de6ce4b11ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:41.934028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59e4d8-2627-4d1d-81c6-de6ce4b11ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.934300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59e4d8-2627-4d1d-81c6-de6ce4b11ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.934565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59e4d8-2627-4d1d-81c6-de6ce4b11ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.945964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59e4d8-2627-4d1d-81c6-de6ce4b11ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:41.947593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59e4d8-2627-4d1d-81c6-de6ce4b11ad9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3a59e4d8-2627-4d1d-81c6-de6ce4b11ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:41.962055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:41.962964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:41.963806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:41.963806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:41.963806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:41.963806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 210/435] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:41.964285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6160cfd-dc77-4594-8009-c9842282ee2c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:41.964511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6160cfd-dc77-4594-8009-c9842282ee2c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:41.964777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6160cfd-dc77-4594-8009-c9842282ee2c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:41.966122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 211/436] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:41.966666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6160cfd-dc77-4594-8009-c9842282ee2c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.031319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b57c19-8ca4-427a-bea0-70c2d930fb38 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.064960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b70b39-5edc-47a2-992a-4b5718a70246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.065581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70b39-5edc-47a2-992a-4b5718a70246 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.065856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70b39-5edc-47a2-992a-4b5718a70246 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.066126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b70b39-5edc-47a2-992a-4b5718a70246 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.066749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b70b39-5edc-47a2-992a-4b5718a70246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:42.067043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b70b39-5edc-47a2-992a-4b5718a70246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:42.067188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6160cfd-dc77-4594-8009-c9842282ee2c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.068401 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b70b39-5edc-47a2-992a-4b5718a70246 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:42.079996 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 226/437] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:42.081175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4e4dc-1523-41e0-83ba-d30c418fa7f3 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.081455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4e4dc-1523-41e0-83ba-d30c418fa7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.081723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4e4dc-1523-41e0-83ba-d30c418fa7f3 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.082885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 227/438] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:42.083561 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4e4dc-1523-41e0-83ba-d30c418fa7f3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.103194 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2957a-6f2e-46f9-b56b-39726468973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.103792 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2957a-6f2e-46f9-b56b-39726468973b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.104068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2957a-6f2e-46f9-b56b-39726468973b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.104336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2957a-6f2e-46f9-b56b-39726468973b None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.104988 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2957a-6f2e-46f9-b56b-39726468973b None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:42.105325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2957a-6f2e-46f9-b56b-39726468973b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:42.106676 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2957a-6f2e-46f9-b56b-39726468973b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:42.110750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:42.115211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 212/439] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:42.116359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6c58-119d-4fdb-99bc-73109d530c0b None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.116637 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6c58-119d-4fdb-99bc-73109d530c0b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.117489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6c58-119d-4fdb-99bc-73109d530c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.135096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e4ac6c58-119d-4fdb-99bc-73109d530c0b None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:42.136266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e4ac6c58-119d-4fdb-99bc-73109d530c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:42.143583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:42.191326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4e4dc-1523-41e0-83ba-d30c418fa7f3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.202172 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 213/440] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:42.202996 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac6c58-119d-4fdb-99bc-73109d530c0b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.226321 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0e246-f74e-42ec-96ba-0bc995153ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.226915 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e246-f74e-42ec-96ba-0bc995153ffc None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.227487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e246-f74e-42ec-96ba-0bc995153ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.227759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e246-f74e-42ec-96ba-0bc995153ffc None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.228393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0e246-f74e-42ec-96ba-0bc995153ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:42.228690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0e246-f74e-42ec-96ba-0bc995153ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:42.230091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0e246-f74e-42ec-96ba-0bc995153ffc None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:42.243630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 228/441] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:42.245033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9df01-1521-41c5-bc61-f5811344a139 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.245346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9df01-1521-41c5-bc61-f5811344a139 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.245614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9df01-1521-41c5-bc61-f5811344a139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.264834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-53b9df01-1521-41c5-bc61-f5811344a139 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:42.266053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-53b9df01-1521-41c5-bc61-f5811344a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:42.320164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac6c58-119d-4fdb-99bc-73109d530c0b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.336704 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 229/442] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:42.337445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9df01-1521-41c5-bc61-f5811344a139 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.357499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:42.369635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0fcf9-a270-4a59-9849-d1e81c1a61d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.371107 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0fcf9-a270-4a59-9849-d1e81c1a61d7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.371650 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0fcf9-a270-4a59-9849-d1e81c1a61d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.374329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0fcf9-a270-4a59-9849-d1e81c1a61d7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.384001 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0fcf9-a270-4a59-9849-d1e81c1a61d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:42.386106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0fcf9-a270-4a59-9849-d1e81c1a61d7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e5c0fcf9-a270-4a59-9849-d1e81c1a61d7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:42.400664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:42.401610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:42.402499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:42.402499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:42.402499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:42.402499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:42.402499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:42.402499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:42.402499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:42.402499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:42.402499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:14:42.402499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:42.403890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 214/443] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:42.405980 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0fcf9-a270-4a59-9849-d1e81c1a61d7 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.409095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:42.461073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9df01-1521-41c5-bc61-f5811344a139 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.499852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74198f6a-532d-49ba-a681-3cf67759e249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.500469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74198f6a-532d-49ba-a681-3cf67759e249 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.500749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74198f6a-532d-49ba-a681-3cf67759e249 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.501048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74198f6a-532d-49ba-a681-3cf67759e249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.512011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74198f6a-532d-49ba-a681-3cf67759e249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:42.513490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74198f6a-532d-49ba-a681-3cf67759e249 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:42.514629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0fcf9-a270-4a59-9849-d1e81c1a61d7 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-74198f6a-532d-49ba-a681-3cf67759e249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:42.527835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:42.528728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:42.529619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:42.529619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:42.529619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:42.529619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 230/444] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:42.529828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74198f6a-532d-49ba-a681-3cf67759e249 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.557409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165c333-b9d4-429c-b1d0-7e16428c4ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.558306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165c333-b9d4-429c-b1d0-7e16428c4ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.558753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165c333-b9d4-429c-b1d0-7e16428c4ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.559192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165c333-b9d4-429c-b1d0-7e16428c4ad4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.565950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165c333-b9d4-429c-b1d0-7e16428c4ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:42.567591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165c333-b9d4-429c-b1d0-7e16428c4ad4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3165c333-b9d4-429c-b1d0-7e16428c4ad4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:42.585879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:42.586979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:42.587826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:42.587826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:42.587826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:42.587826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:42.587826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:42.587826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:42.587826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:42.587826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:42.589529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 215/445] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:42.590437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165c333-b9d4-429c-b1d0-7e16428c4ad4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.608044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:42.641854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74198f6a-532d-49ba-a681-3cf67759e249 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.653579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:42.675887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926e5fb-ff3e-4e99-9a9f-ba02b683d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.676486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926e5fb-ff3e-4e99-9a9f-ba02b683d104 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.676760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926e5fb-ff3e-4e99-9a9f-ba02b683d104 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.677061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926e5fb-ff3e-4e99-9a9f-ba02b683d104 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.677781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926e5fb-ff3e-4e99-9a9f-ba02b683d104 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:42.678084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926e5fb-ff3e-4e99-9a9f-ba02b683d104 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:42.680097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926e5fb-ff3e-4e99-9a9f-ba02b683d104 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:42.692675 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165c333-b9d4-429c-b1d0-7e16428c4ad4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.698955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 231/446] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 2 07:14:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:42.700162 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926e5fb-ff3e-4e99-9a9f-ba02b683d104 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.726354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b4af0-e745-4ea4-8964-b1f9e1b0bca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.726975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4af0-e745-4ea4-8964-b1f9e1b0bca0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.727256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4af0-e745-4ea4-8964-b1f9e1b0bca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.727523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4af0-e745-4ea4-8964-b1f9e1b0bca0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.737402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b4af0-e745-4ea4-8964-b1f9e1b0bca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-123b4af0-e745-4ea4-8964-b1f9e1b0bca0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:42.743498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:42.744357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:42.745192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 216/447] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:42.745880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b4af0-e745-4ea4-8964-b1f9e1b0bca0 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.801301 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926e5fb-ff3e-4e99-9a9f-ba02b683d104 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.827237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:42.836310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb04b4e-4a10-49ea-ad0c-2a1a678d5d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.836851 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb04b4e-4a10-49ea-ad0c-2a1a678d5d97 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.837148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb04b4e-4a10-49ea-ad0c-2a1a678d5d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.837415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb04b4e-4a10-49ea-ad0c-2a1a678d5d97 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.838039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb04b4e-4a10-49ea-ad0c-2a1a678d5d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:42.838331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb04b4e-4a10-49ea-ad0c-2a1a678d5d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:42.839673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb04b4e-4a10-49ea-ad0c-2a1a678d5d97 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:42.844983 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b4af0-e745-4ea4-8964-b1f9e1b0bca0 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.850810 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 232/448] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:42.855510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb04b4e-4a10-49ea-ad0c-2a1a678d5d97 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.867829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:42.879312 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c10e6-aa33-4cb7-97a6-453658262636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.879912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c10e6-aa33-4cb7-97a6-453658262636 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.880183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c10e6-aa33-4cb7-97a6-453658262636 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.880454 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c10e6-aa33-4cb7-97a6-453658262636 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.881157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c10e6-aa33-4cb7-97a6-453658262636 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:42.881461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c10e6-aa33-4cb7-97a6-453658262636 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:42.883555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c10e6-aa33-4cb7-97a6-453658262636 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:42.894974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 217/449] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:42.895756 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c10e6-aa33-4cb7-97a6-453658262636 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:42.958482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb04b4e-4a10-49ea-ad0c-2a1a678d5d97 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:42.992383 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e66f1-4938-4971-8b43-23d918c46346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:42.993001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e66f1-4938-4971-8b43-23d918c46346 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:42.993302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e66f1-4938-4971-8b43-23d918c46346 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:42.993568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e66f1-4938-4971-8b43-23d918c46346 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:42.997533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c10e6-aa33-4cb7-97a6-453658262636 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:43.003739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e66f1-4938-4971-8b43-23d918c46346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-315e66f1-4938-4971-8b43-23d918c46346 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:43.008970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:43.009919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:43.010735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 233/450] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:43.011385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e66f1-4938-4971-8b43-23d918c46346 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.033182 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db834e5-1d52-419d-b79b-836977042086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:43.033781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db834e5-1d52-419d-b79b-836977042086 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:43.034050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db834e5-1d52-419d-b79b-836977042086 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:43.034311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db834e5-1d52-419d-b79b-836977042086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:43.057844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:43.082127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:43.101368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db834e5-1d52-419d-b79b-836977042086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:43.102781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db834e5-1d52-419d-b79b-836977042086 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:43.110372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e66f1-4938-4971-8b43-23d918c46346 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:43.143075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843baf1-bc5d-4386-845d-c87ab36a8bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:43.143662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843baf1-bc5d-4386-845d-c87ab36a8bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:43.143931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843baf1-bc5d-4386-845d-c87ab36a8bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:43.144194 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843baf1-bc5d-4386-845d-c87ab36a8bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:43.144835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843baf1-bc5d-4386-845d-c87ab36a8bb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:43.145158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843baf1-bc5d-4386-845d-c87ab36a8bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:43.146492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843baf1-bc5d-4386-845d-c87ab36a8bb4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:43.154405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 234/451] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:43.155168 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843baf1-bc5d-4386-845d-c87ab36a8bb4 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.204085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 218/452] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:14:43.204880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db834e5-1d52-419d-b79b-836977042086 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.252225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843baf1-bc5d-4386-845d-c87ab36a8bb4 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:43.261249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:43.285113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:43.287046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305c4fd-61a2-4a51-9eb0-40f08dd34661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:43.288165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305c4fd-61a2-4a51-9eb0-40f08dd34661 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:43.288833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305c4fd-61a2-4a51-9eb0-40f08dd34661 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:43.288833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305c4fd-61a2-4a51-9eb0-40f08dd34661 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:43.296088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305c4fd-61a2-4a51-9eb0-40f08dd34661 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:43.297554 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305c4fd-61a2-4a51-9eb0-40f08dd34661 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:43.303285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db834e5-1d52-419d-b79b-836977042086 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-1305c4fd-61a2-4a51-9eb0-40f08dd34661 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:43.308691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:43.309579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:43.310455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 235/453] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 07:14:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:43.311010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305c4fd-61a2-4a51-9eb0-40f08dd34661 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.342331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782e378-df9b-4546-88ab-9d052fc243d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:43.342982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782e378-df9b-4546-88ab-9d052fc243d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:43.343269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782e378-df9b-4546-88ab-9d052fc243d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:43.343523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782e378-df9b-4546-88ab-9d052fc243d6 None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/d80d3e8c42ab4942b32618db3f19dd88/roles/f6ee9e8014884bc5aff06380618f6aa2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:43.358894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782e378-df9b-4546-88ab-9d052fc243d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=d80d3e8c42ab4942b32618db3f19dd88, role_id=f6ee9e8014884bc5aff06380618f6aa2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:43.360275 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782e378-df9b-4546-88ab-9d052fc243d6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:43.372907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 219/454] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:14:43 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/d80d3e8c42ab4942b32618db3f19dd88/roles/f6ee9e8014884bc5aff06380618f6aa2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:43.373739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782e378-df9b-4546-88ab-9d052fc243d6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.427323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305c4fd-61a2-4a51-9eb0-40f08dd34661 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:43.470887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6767-c679-49c7-9172-ada7e43f1db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:43.471510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6767-c679-49c7-9172-ada7e43f1db6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:43.471785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6767-c679-49c7-9172-ada7e43f1db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:43.472054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6767-c679-49c7-9172-ada7e43f1db6 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:43.472727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6767-c679-49c7-9172-ada7e43f1db6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:43.473048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6767-c679-49c7-9172-ada7e43f1db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:43.474487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6767-c679-49c7-9172-ada7e43f1db6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:43.485048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 236/455] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:43.490753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6767-c679-49c7-9172-ada7e43f1db6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.493132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782e378-df9b-4546-88ab-9d052fc243d6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:43.527058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:43.530455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:43.533333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ff76d-c81d-4ad1-81e6-1ff8dd1ae7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:43.533935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff76d-c81d-4ad1-81e6-1ff8dd1ae7db None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:43.534845 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff76d-c81d-4ad1-81e6-1ff8dd1ae7db None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:43.534956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff76d-c81d-4ad1-81e6-1ff8dd1ae7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:43.548226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ff76d-c81d-4ad1-81e6-1ff8dd1ae7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:43.549621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ff76d-c81d-4ad1-81e6-1ff8dd1ae7db None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-500ff76d-c81d-4ad1-81e6-1ff8dd1ae7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:43.567807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:43.568909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:43.569920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:43.569920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:43.569920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:43.569920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 220/456] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:43.570163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ff76d-c81d-4ad1-81e6-1ff8dd1ae7db None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.614086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6767-c679-49c7-9172-ada7e43f1db6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:43.652570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a8a9-3af2-494a-ae04-78d154889ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:43.653457 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a8a9-3af2-494a-ae04-78d154889ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:43.653877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a8a9-3af2-494a-ae04-78d154889ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:43.654347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a8a9-3af2-494a-ae04-78d154889ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:43.666401 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133a8a9-3af2-494a-ae04-78d154889ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:43.668244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133a8a9-3af2-494a-ae04-78d154889ee6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:43.673142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ff76d-c81d-4ad1-81e6-1ff8dd1ae7db None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0133a8a9-3af2-494a-ae04-78d154889ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:43.684899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:43.686021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:43.687086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:43.687086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:43.687086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:43.693419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 237/457] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:43.694614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a8a9-3af2-494a-ae04-78d154889ee6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.708033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf5d1b-5ac6-4291-bb20-ca009f693a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:43.708920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5d1b-5ac6-4291-bb20-ca009f693a08 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:43.709228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5d1b-5ac6-4291-bb20-ca009f693a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:43.709501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf5d1b-5ac6-4291-bb20-ca009f693a08 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:43.710216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf5d1b-5ac6-4291-bb20-ca009f693a08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:43.711048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf5d1b-5ac6-4291-bb20-ca009f693a08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:43.712467 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf5d1b-5ac6-4291-bb20-ca009f693a08 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:43.731750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 221/458] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 07:14:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:43.732655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf5d1b-5ac6-4291-bb20-ca009f693a08 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.775115 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:43.792523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:43.812574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a8a9-3af2-494a-ae04-78d154889ee6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:43.839166 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf5d1b-5ac6-4291-bb20-ca009f693a08 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:43.848630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250786c8-c97e-46e3-8600-3d54415f4734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:43.849290 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250786c8-c97e-46e3-8600-3d54415f4734 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:43.849565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250786c8-c97e-46e3-8600-3d54415f4734 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:43.849831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250786c8-c97e-46e3-8600-3d54415f4734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:43.860935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250786c8-c97e-46e3-8600-3d54415f4734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:43.862400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250786c8-c97e-46e3-8600-3d54415f4734 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:43.875407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b120-168d-4b78-9d4a-fdda2546a971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:43.875947 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b120-168d-4b78-9d4a-fdda2546a971 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:43.876224 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b120-168d-4b78-9d4a-fdda2546a971 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:43.876494 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b120-168d-4b78-9d4a-fdda2546a971 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-250786c8-c97e-46e3-8600-3d54415f4734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:43.876761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:43.877781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:43.879173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:43.879173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:43.879173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:43.879346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b120-168d-4b78-9d4a-fdda2546a971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:43.879346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b120-168d-4b78-9d4a-fdda2546a971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:43.879482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 238/459] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:43.879482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250786c8-c97e-46e3-8600-3d54415f4734 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.884201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b120-168d-4b78-9d4a-fdda2546a971 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:43.895511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 222/460] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:43.896317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b120-168d-4b78-9d4a-fdda2546a971 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:43.997960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250786c8-c97e-46e3-8600-3d54415f4734 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.006713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b120-168d-4b78-9d4a-fdda2546a971 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.009480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:44.034215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2920df-1601-49a5-ac5a-3cef10426b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.034820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2920df-1601-49a5-ac5a-3cef10426b42 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.035263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2920df-1601-49a5-ac5a-3cef10426b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.035531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2920df-1601-49a5-ac5a-3cef10426b42 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.036514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2920df-1601-49a5-ac5a-3cef10426b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:44.036961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2920df-1601-49a5-ac5a-3cef10426b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.038338 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2920df-1601-49a5-ac5a-3cef10426b42 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.040054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:44.046907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aad0c0-4dd7-4dd3-86a7-8ecf57762c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.047517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aad0c0-4dd7-4dd3-86a7-8ecf57762c14 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.047790 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aad0c0-4dd7-4dd3-86a7-8ecf57762c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.048057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aad0c0-4dd7-4dd3-86a7-8ecf57762c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.052725 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 239/461] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:44.053651 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2920df-1601-49a5-ac5a-3cef10426b42 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.142713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aad0c0-4dd7-4dd3-86a7-8ecf57762c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.144475 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aad0c0-4dd7-4dd3-86a7-8ecf57762c14 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.157661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2920df-1601-49a5-ac5a-3cef10426b42 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.195424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007cc62-f197-461a-8418-180834ac336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.196062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007cc62-f197-461a-8418-180834ac336f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.196338 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007cc62-f197-461a-8418-180834ac336f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.196731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007cc62-f197-461a-8418-180834ac336f None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.197398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007cc62-f197-461a-8418-180834ac336f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:44.197707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007cc62-f197-461a-8418-180834ac336f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.199084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007cc62-f197-461a-8418-180834ac336f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.210645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 240/462] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:44.211471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007cc62-f197-461a-8418-180834ac336f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.263244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 223/463] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:14:44.263244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aad0c0-4dd7-4dd3-86a7-8ecf57762c14 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.266852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:44.279891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:44.328599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007cc62-f197-461a-8418-180834ac336f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.367605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9fb89-9d4f-4361-81f8-4107e3b3bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.368332 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9fb89-9d4f-4361-81f8-4107e3b3bec9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.368680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9fb89-9d4f-4361-81f8-4107e3b3bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.369060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9fb89-9d4f-4361-81f8-4107e3b3bec9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.377184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9fb89-9d4f-4361-81f8-4107e3b3bec9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.377711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aad0c0-4dd7-4dd3-86a7-8ecf57762c14 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.378641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9fb89-9d4f-4361-81f8-4107e3b3bec9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-30c9fb89-9d4f-4361-81f8-4107e3b3bec9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:44.390272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:44.391249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 241/464] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:44.392167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9fb89-9d4f-4361-81f8-4107e3b3bec9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.419847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12a5ea-b4e2-4a38-8097-f367dc3b365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.420398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12a5ea-b4e2-4a38-8097-f367dc3b365f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.420677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12a5ea-b4e2-4a38-8097-f367dc3b365f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.420941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12a5ea-b4e2-4a38-8097-f367dc3b365f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.427669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12a5ea-b4e2-4a38-8097-f367dc3b365f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.429717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12a5ea-b4e2-4a38-8097-f367dc3b365f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-4a12a5ea-b4e2-4a38-8097-f367dc3b365f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:44.441308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:44.442156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:44.442992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:44.442992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:44.442992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:44.442992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:44.442992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:44.442992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:44.442992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:44.442992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:44.442992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 224/465] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:44.443447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12a5ea-b4e2-4a38-8097-f367dc3b365f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.505613 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9fb89-9d4f-4361-81f8-4107e3b3bec9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.512339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:44.520592 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:44.548885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb5001-ac45-4c29-9a6e-7ee8a6c17827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.549633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb5001-ac45-4c29-9a6e-7ee8a6c17827 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.549983 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb5001-ac45-4c29-9a6e-7ee8a6c17827 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.550329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb5001-ac45-4c29-9a6e-7ee8a6c17827 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.555695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12a5ea-b4e2-4a38-8097-f367dc3b365f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.559640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb5001-ac45-4c29-9a6e-7ee8a6c17827 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.561264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb5001-ac45-4c29-9a6e-7ee8a6c17827 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-08bb5001-ac45-4c29-9a6e-7ee8a6c17827 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:44.573828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:44.574932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:44.576029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:44.576029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:44.576029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:44.576029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:44.576029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:44.576029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:44.576029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:44.576029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:44.576029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:14:44.576029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:44.580066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 242/466] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:44.580767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb5001-ac45-4c29-9a6e-7ee8a6c17827 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.595986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775cfdc-b954-43fb-b98f-c0b600fdcce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.596713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775cfdc-b954-43fb-b98f-c0b600fdcce1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.597085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775cfdc-b954-43fb-b98f-c0b600fdcce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.597426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775cfdc-b954-43fb-b98f-c0b600fdcce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.609613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775cfdc-b954-43fb-b98f-c0b600fdcce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.611121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775cfdc-b954-43fb-b98f-c0b600fdcce1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-9775cfdc-b954-43fb-b98f-c0b600fdcce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:44.626221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:44.627377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:44.628285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:44.628285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:44.628285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:44.628285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 225/467] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:44.628883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775cfdc-b954-43fb-b98f-c0b600fdcce1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.694216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb5001-ac45-4c29-9a6e-7ee8a6c17827 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.732466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f2e94-8b56-46a6-bb30-6dfb070e52c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.733260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f2e94-8b56-46a6-bb30-6dfb070e52c4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.733638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f2e94-8b56-46a6-bb30-6dfb070e52c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.734014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f2e94-8b56-46a6-bb30-6dfb070e52c4 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.734834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f2e94-8b56-46a6-bb30-6dfb070e52c4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:44.735244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f2e94-8b56-46a6-bb30-6dfb070e52c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.736664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f2e94-8b56-46a6-bb30-6dfb070e52c4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.743273 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775cfdc-b954-43fb-b98f-c0b600fdcce1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.755350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 243/468] 10.222.0.13 () {56 vars in 1137 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:44.756146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f2e94-8b56-46a6-bb30-6dfb070e52c4 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.762971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:44.782531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4afb39-5507-4e37-a315-f93c9785366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.783130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4afb39-5507-4e37-a315-f93c9785366c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.783406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4afb39-5507-4e37-a315-f93c9785366c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.783670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4afb39-5507-4e37-a315-f93c9785366c None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.784584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4afb39-5507-4e37-a315-f93c9785366c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:44.784696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4afb39-5507-4e37-a315-f93c9785366c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.786067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4afb39-5507-4e37-a315-f93c9785366c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.791744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:44.799211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 226/469] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:44.799827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4afb39-5507-4e37-a315-f93c9785366c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.871595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f2e94-8b56-46a6-bb30-6dfb070e52c4 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.902470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4afb39-5507-4e37-a315-f93c9785366c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:44.912325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20434f-452d-4444-bbf2-814b18dd8f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.915584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20434f-452d-4444-bbf2-814b18dd8f49 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.916683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20434f-452d-4444-bbf2-814b18dd8f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.916953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20434f-452d-4444-bbf2-814b18dd8f49 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.917721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20434f-452d-4444-bbf2-814b18dd8f49 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:44.918086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20434f-452d-4444-bbf2-814b18dd8f49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.919534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20434f-452d-4444-bbf2-814b18dd8f49 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.938940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 244/470] 10.222.0.13 () {56 vars in 1139 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:44.940022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20434f-452d-4444-bbf2-814b18dd8f49 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.947883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41e76e-1d71-428d-b9ee-a1b8f4590379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:44.948425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41e76e-1d71-428d-b9ee-a1b8f4590379 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:44.948695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41e76e-1d71-428d-b9ee-a1b8f4590379 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:44.948958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41e76e-1d71-428d-b9ee-a1b8f4590379 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:44.949617 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41e76e-1d71-428d-b9ee-a1b8f4590379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:44.949915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41e76e-1d71-428d-b9ee-a1b8f4590379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:44.951277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41e76e-1d71-428d-b9ee-a1b8f4590379 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:44.963018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 227/471] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:44.963825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41e76e-1d71-428d-b9ee-a1b8f4590379 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:44.997824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:45.054013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:45.065394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20434f-452d-4444-bbf2-814b18dd8f49 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:45.065826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41e76e-1d71-428d-b9ee-a1b8f4590379 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:45.100068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11151695-35ae-4448-b18c-f88dcefb7c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:45.100667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151695-35ae-4448-b18c-f88dcefb7c2c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:45.100947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151695-35ae-4448-b18c-f88dcefb7c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:45.101379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151695-35ae-4448-b18c-f88dcefb7c2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:45.102075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096e891-d995-4a65-a10b-6c1cdc681619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:45.102910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e891-d995-4a65-a10b-6c1cdc681619 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:45.103328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e891-d995-4a65-a10b-6c1cdc681619 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:45.103737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e891-d995-4a65-a10b-6c1cdc681619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:45.104754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096e891-d995-4a65-a10b-6c1cdc681619 None admin] RBAC: Adding query filter params (role.id=f6ee9e8014884bc5aff06380618f6aa2, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=c27a93c04181493593a069650a977773) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:45.105085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096e891-d995-4a65-a10b-6c1cdc681619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:45.106563 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096e891-d995-4a65-a10b-6c1cdc681619 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:45.121049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 228/472] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/role_assignments?user.id=c27a93c04181493593a069650a977773&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=f6ee9e8014884bc5aff06380618f6aa2 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:45.121049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096e891-d995-4a65-a10b-6c1cdc681619 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:45.201717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11151695-35ae-4448-b18c-f88dcefb7c2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:45.204090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11151695-35ae-4448-b18c-f88dcefb7c2c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:45.264647 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:45.270318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096e891-d995-4a65-a10b-6c1cdc681619 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:45.310923 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66071859-1df1-45ec-a44f-2f2c4448224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:45.311704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66071859-1df1-45ec-a44f-2f2c4448224f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:45.311977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66071859-1df1-45ec-a44f-2f2c4448224f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:45.312532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66071859-1df1-45ec-a44f-2f2c4448224f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:45.319135 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:45.334785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 245/473] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:14:45.337270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11151695-35ae-4448-b18c-f88dcefb7c2c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:45.409163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66071859-1df1-45ec-a44f-2f2c4448224f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:45.410894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66071859-1df1-45ec-a44f-2f2c4448224f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:45.473335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11151695-35ae-4448-b18c-f88dcefb7c2c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:45.508161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82285f3b-c31c-4434-af90-bb4bc88198bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:45.509185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82285f3b-c31c-4434-af90-bb4bc88198bd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:45.509717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82285f3b-c31c-4434-af90-bb4bc88198bd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:45.510178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82285f3b-c31c-4434-af90-bb4bc88198bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:45.518283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82285f3b-c31c-4434-af90-bb4bc88198bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:45.520464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82285f3b-c31c-4434-af90-bb4bc88198bd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-82285f3b-c31c-4434-af90-bb4bc88198bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:45.534410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:45.535295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:45.536125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:45.536125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:45.536125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:45.536125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:45.536125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:45.536125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:45.536125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:45.536125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:45.538434 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 246/474] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:45.545314 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82285f3b-c31c-4434-af90-bb4bc88198bd None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:45.547303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:45.555192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 229/475] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:14:45.556683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66071859-1df1-45ec-a44f-2f2c4448224f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:45.600341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:45.655434 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66071859-1df1-45ec-a44f-2f2c4448224f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:45.658048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82285f3b-c31c-4434-af90-bb4bc88198bd None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:45.688625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd13b64-edb8-4733-ad04-ebdf56dbd15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:45.689263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13b64-edb8-4733-ad04-ebdf56dbd15b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:45.689538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13b64-edb8-4733-ad04-ebdf56dbd15b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:45.689808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13b64-edb8-4733-ad04-ebdf56dbd15b None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:45.690488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd13b64-edb8-4733-ad04-ebdf56dbd15b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:45.690788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd13b64-edb8-4733-ad04-ebdf56dbd15b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:45.692214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd13b64-edb8-4733-ad04-ebdf56dbd15b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:45.696311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dea3b0-85cf-4410-901e-8647dfaf88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:45.697532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea3b0-85cf-4410-901e-8647dfaf88e2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:45.697994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea3b0-85cf-4410-901e-8647dfaf88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:45.698443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea3b0-85cf-4410-901e-8647dfaf88e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:45.705246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 230/476] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:45.706442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5a80a-31ce-4dc7-b317-41544dc3945c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:45.706726 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5a80a-31ce-4dc7-b317-41544dc3945c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:45.706993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5a80a-31ce-4dc7-b317-41544dc3945c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:45.712292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 231/477] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:45.712292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5a80a-31ce-4dc7-b317-41544dc3945c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:45.717604 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dea3b0-85cf-4410-901e-8647dfaf88e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:45.719419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dea3b0-85cf-4410-901e-8647dfaf88e2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-e1dea3b0-85cf-4410-901e-8647dfaf88e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:45.736902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:45.737957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:45.738797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:45.738797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:45.738797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:45.738797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 247/478] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:45.739400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dea3b0-85cf-4410-901e-8647dfaf88e2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:45.778442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:45.822997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5a80a-31ce-4dc7-b317-41544dc3945c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:45.853879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dea3b0-85cf-4410-901e-8647dfaf88e2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:45.855521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:45.858330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6716d-cb85-4680-9dba-2db79be7d228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:45.859389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6716d-cb85-4680-9dba-2db79be7d228 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:45.859598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6716d-cb85-4680-9dba-2db79be7d228 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:45.859869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6716d-cb85-4680-9dba-2db79be7d228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:45.872269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6716d-cb85-4680-9dba-2db79be7d228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:45.873920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6716d-cb85-4680-9dba-2db79be7d228 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-92a6716d-cb85-4680-9dba-2db79be7d228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:45.888195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:45.889348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:45.893967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:45.893967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:45.893967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:45.893967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 232/479] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:45.893967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf02a42-3dc1-4f27-ae69-bfd625300378 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:45.893967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf02a42-3dc1-4f27-ae69-bfd625300378 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:45.893967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf02a42-3dc1-4f27-ae69-bfd625300378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:45.899066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a28de-8699-4dcd-a953-49cc1732f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:45.899665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a28de-8699-4dcd-a953-49cc1732f826 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:45.900699 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a28de-8699-4dcd-a953-49cc1732f826 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:45.900699 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a28de-8699-4dcd-a953-49cc1732f826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:45.901067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a28de-8699-4dcd-a953-49cc1732f826 None admin] RBAC: Adding query filter params (role.id=f6ee9e8014884bc5aff06380618f6aa2, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=ad0826bb58db4100b0d807fb07734deb) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:45.904154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a28de-8699-4dcd-a953-49cc1732f826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:45.904154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a28de-8699-4dcd-a953-49cc1732f826 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:45.917055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 248/480] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:14:45 2022] GET /identity/v3/role_assignments?user.id=ad0826bb58db4100b0d807fb07734deb&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=f6ee9e8014884bc5aff06380618f6aa2 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:45.917055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a28de-8699-4dcd-a953-49cc1732f826 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:45.920659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5bf02a42-3dc1-4f27-ae69-bfd625300378 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:45.920659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5bf02a42-3dc1-4f27-ae69-bfd625300378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:46.004958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 233/481] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:46.005932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf02a42-3dc1-4f27-ae69-bfd625300378 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:46.063245 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a28de-8699-4dcd-a953-49cc1732f826 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:46.075680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:46.149833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62751aca-819b-4470-a71f-11e5534f3e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:46.150676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751aca-819b-4470-a71f-11e5534f3e51 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:46.150953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751aca-819b-4470-a71f-11e5534f3e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:46.151601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751aca-819b-4470-a71f-11e5534f3e51 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:46.152259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62751aca-819b-4470-a71f-11e5534f3e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:46.152561 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62751aca-819b-4470-a71f-11e5534f3e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:46.154011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62751aca-819b-4470-a71f-11e5534f3e51 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:46.169808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf02a42-3dc1-4f27-ae69-bfd625300378 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:46.170439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 249/482] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:46.175723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62751aca-819b-4470-a71f-11e5534f3e51 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:46.207803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7734c8c-9e41-4022-b7c7-1e81063fa1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:46.208409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7734c8c-9e41-4022-b7c7-1e81063fa1fd None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:46.208683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7734c8c-9e41-4022-b7c7-1e81063fa1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:46.208953 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7734c8c-9e41-4022-b7c7-1e81063fa1fd None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:46.209639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7734c8c-9e41-4022-b7c7-1e81063fa1fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:46.209926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7734c8c-9e41-4022-b7c7-1e81063fa1fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:46.211553 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7734c8c-9e41-4022-b7c7-1e81063fa1fd None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:46.217463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:46.224643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 234/483] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:46.238010 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7734c8c-9e41-4022-b7c7-1e81063fa1fd None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:46.321435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62751aca-819b-4470-a71f-11e5534f3e51 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:46.371552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12151aa2-d880-46a1-9643-3a0d8ee5e309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:46.372420 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12151aa2-d880-46a1-9643-3a0d8ee5e309 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:46.372890 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12151aa2-d880-46a1-9643-3a0d8ee5e309 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:46.373327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12151aa2-d880-46a1-9643-3a0d8ee5e309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:46.383002 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:46.385151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12151aa2-d880-46a1-9643-3a0d8ee5e309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:46.386450 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7734c8c-9e41-4022-b7c7-1e81063fa1fd None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:46.387453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12151aa2-d880-46a1-9643-3a0d8ee5e309 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-12151aa2-d880-46a1-9643-3a0d8ee5e309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:46.400337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:46.401388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:46.402221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:46.402221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:46.402221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:46.402221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:46.402221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:46.402221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:46.402221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:46.402221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:46.405054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 250/484] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:46.406172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12151aa2-d880-46a1-9643-3a0d8ee5e309 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:46.425835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50000311-1303-4359-a92d-a69b306e4fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:46.426812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50000311-1303-4359-a92d-a69b306e4fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:46.427287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50000311-1303-4359-a92d-a69b306e4fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:46.427800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50000311-1303-4359-a92d-a69b306e4fa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:46.435223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50000311-1303-4359-a92d-a69b306e4fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:46.436922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50000311-1303-4359-a92d-a69b306e4fa5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-50000311-1303-4359-a92d-a69b306e4fa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:46.449343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:46.450198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:46.451127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:46.451127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:46.451127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:46.451127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:46.451127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:46.451127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:46.451127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:46.451127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:46.453469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 235/485] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:46.454501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50000311-1303-4359-a92d-a69b306e4fa5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:46.507584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:46.528049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12151aa2-d880-46a1-9643-3a0d8ee5e309 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:46.564492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50000311-1303-4359-a92d-a69b306e4fa5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:46.572986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c488cb5-c6c5-4f1b-a45c-9e50049e800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:46.574311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c488cb5-c6c5-4f1b-a45c-9e50049e800d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:46.574833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c488cb5-c6c5-4f1b-a45c-9e50049e800d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:46.575663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c488cb5-c6c5-4f1b-a45c-9e50049e800d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:46.589361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c488cb5-c6c5-4f1b-a45c-9e50049e800d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9c488cb5-c6c5-4f1b-a45c-9e50049e800d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:46.595972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:46.597058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:46.597978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:46.604590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f085-eae3-4d3d-bfff-89ab98bf4240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:46.604590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f085-eae3-4d3d-bfff-89ab98bf4240 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:46.604590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f085-eae3-4d3d-bfff-89ab98bf4240 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:46.604590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f085-eae3-4d3d-bfff-89ab98bf4240 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:46.604987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405f085-eae3-4d3d-bfff-89ab98bf4240 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:46.604987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405f085-eae3-4d3d-bfff-89ab98bf4240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:46.605410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 251/486] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:46.605800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405f085-eae3-4d3d-bfff-89ab98bf4240 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:46.606580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c488cb5-c6c5-4f1b-a45c-9e50049e800d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:46.619064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 236/487] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:46.619968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f085-eae3-4d3d-bfff-89ab98bf4240 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:46.645421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:46.722684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f085-eae3-4d3d-bfff-89ab98bf4240 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:46.724691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c488cb5-c6c5-4f1b-a45c-9e50049e800d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:46.766381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671eebe-1f89-4ef3-935e-14f2f1a9026b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:46.767225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671eebe-1f89-4ef3-935e-14f2f1a9026b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:46.767644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671eebe-1f89-4ef3-935e-14f2f1a9026b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:46.768075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671eebe-1f89-4ef3-935e-14f2f1a9026b None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:46.768678 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5c16-2d5e-4201-b583-0ce6bd2366c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:46.769140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671eebe-1f89-4ef3-935e-14f2f1a9026b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:46.769319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5c16-2d5e-4201-b583-0ce6bd2366c6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:46.769600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5c16-2d5e-4201-b583-0ce6bd2366c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:46.769876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5c16-2d5e-4201-b583-0ce6bd2366c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:46.769997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671eebe-1f89-4ef3-935e-14f2f1a9026b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:46.770535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5c16-2d5e-4201-b583-0ce6bd2366c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:46.770835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5c16-2d5e-4201-b583-0ce6bd2366c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:46.771825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671eebe-1f89-4ef3-935e-14f2f1a9026b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:46.772255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5c16-2d5e-4201-b583-0ce6bd2366c6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:46.787488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 237/488] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:46.787488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5c16-2d5e-4201-b583-0ce6bd2366c6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:46.793339 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 252/489] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:46.794479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671eebe-1f89-4ef3-935e-14f2f1a9026b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:46.804159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:46.892183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:46.913494 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5c16-2d5e-4201-b583-0ce6bd2366c6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:46.937400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671eebe-1f89-4ef3-935e-14f2f1a9026b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:46.951194 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5d364-2014-4e81-ad5a-3528954f134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:46.952008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5d364-2014-4e81-ad5a-3528954f134f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:46.952451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5d364-2014-4e81-ad5a-3528954f134f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:46.952862 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5d364-2014-4e81-ad5a-3528954f134f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:46.953816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5d364-2014-4e81-ad5a-3528954f134f None admin] RBAC: Adding query filter params (role.id=f6ee9e8014884bc5aff06380618f6aa2, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=2972059254094f8e909eb2adbb0b2257) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:46.954263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5d364-2014-4e81-ad5a-3528954f134f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:46.955920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5d364-2014-4e81-ad5a-3528954f134f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:46.962511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 238/490] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:14:46 2022] GET /identity/v3/role_assignments?user.id=2972059254094f8e909eb2adbb0b2257&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=f6ee9e8014884bc5aff06380618f6aa2 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:46.963456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5d364-2014-4e81-ad5a-3528954f134f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:47.001905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e1644-b07d-4aa5-8bba-80683471236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:47.002814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e1644-b07d-4aa5-8bba-80683471236e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:47.003236 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e1644-b07d-4aa5-8bba-80683471236e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:47.003852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e1644-b07d-4aa5-8bba-80683471236e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:47.030198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e1644-b07d-4aa5-8bba-80683471236e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:47.031933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e1644-b07d-4aa5-8bba-80683471236e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-e70e1644-b07d-4aa5-8bba-80683471236e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:47.065512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:47.066690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:47.067694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:47.067694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:47.067694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:47.079489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 253/491] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:47.081397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e1644-b07d-4aa5-8bba-80683471236e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:47.158465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:47.216665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e1644-b07d-4aa5-8bba-80683471236e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:47.225772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5d364-2014-4e81-ad5a-3528954f134f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:47.266608 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837949-bf43-46ed-9139-795f5a3d9b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:47.267743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837949-bf43-46ed-9139-795f5a3d9b5d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:47.268269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837949-bf43-46ed-9139-795f5a3d9b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:47.268743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837949-bf43-46ed-9139-795f5a3d9b5d None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:47.269701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837949-bf43-46ed-9139-795f5a3d9b5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:47.270101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef056d-9ec7-4f8a-87e3-abc147fdc8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:47.270411 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837949-bf43-46ed-9139-795f5a3d9b5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:47.270857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef056d-9ec7-4f8a-87e3-abc147fdc8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:47.271200 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef056d-9ec7-4f8a-87e3-abc147fdc8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:47.271544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef056d-9ec7-4f8a-87e3-abc147fdc8a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:47.272353 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef056d-9ec7-4f8a-87e3-abc147fdc8a8 None admin] RBAC: Adding query filter params (role.id=f6ee9e8014884bc5aff06380618f6aa2, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=7f1a24bf15594b12bbf59741fcb46cf9) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:47.272743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef056d-9ec7-4f8a-87e3-abc147fdc8a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:47.273740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837949-bf43-46ed-9139-795f5a3d9b5d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:47.275411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef056d-9ec7-4f8a-87e3-abc147fdc8a8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:47.283842 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 239/492] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:14:46 2022] GET /identity/v3/role_assignments?user.id=7f1a24bf15594b12bbf59741fcb46cf9&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=f6ee9e8014884bc5aff06380618f6aa2 => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:47.293478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 254/493] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:47.302119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef056d-9ec7-4f8a-87e3-abc147fdc8a8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:47.318517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:47.438082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef056d-9ec7-4f8a-87e3-abc147fdc8a8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:47.500823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735817a9-947a-44f2-84fe-9fe3602fce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:47.502360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735817a9-947a-44f2-84fe-9fe3602fce04 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:47.502360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735817a9-947a-44f2-84fe-9fe3602fce04 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:47.502360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735817a9-947a-44f2-84fe-9fe3602fce04 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:47.506051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcf0d8-d398-4dc5-9d0f-418ef0d9aba8 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:47.506336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcf0d8-d398-4dc5-9d0f-418ef0d9aba8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:47.506602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcf0d8-d398-4dc5-9d0f-418ef0d9aba8 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:47.508513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 255/494] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:47.511686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735817a9-947a-44f2-84fe-9fe3602fce04 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:47.513177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735817a9-947a-44f2-84fe-9fe3602fce04 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:47.514180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be105a69-cfdf-4096-87e1-261771e4b555 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:47.514455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be105a69-cfdf-4096-87e1-261771e4b555 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:47.514718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be105a69-cfdf-4096-87e1-261771e4b555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-735817a9-947a-44f2-84fe-9fe3602fce04 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:47.526413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:47.527355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:47.528681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 240/495] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:14:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:47.534992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735817a9-947a-44f2-84fe-9fe3602fce04 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:47.535504 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-be105a69-cfdf-4096-87e1-261771e4b555 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:47.536671 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-be105a69-cfdf-4096-87e1-261771e4b555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:47.610129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 256/496] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:47.632206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:47.669209 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735817a9-947a-44f2-84fe-9fe3602fce04 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:47.712495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770fc82-4931-47c6-b30c-0585f56e4531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:47.713040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770fc82-4931-47c6-b30c-0585f56e4531 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:47.713331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770fc82-4931-47c6-b30c-0585f56e4531 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:47.713606 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770fc82-4931-47c6-b30c-0585f56e4531 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:47.714344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770fc82-4931-47c6-b30c-0585f56e4531 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:47.714649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770fc82-4931-47c6-b30c-0585f56e4531 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:47.716078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770fc82-4931-47c6-b30c-0585f56e4531 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:47.735993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 241/497] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 07:14:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:47.741577 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be105a69-cfdf-4096-87e1-261771e4b555 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:47.827878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:47.901048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be105a69-cfdf-4096-87e1-261771e4b555 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:47.966823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5f32-6b6b-4e34-ac28-3808f367e35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:47.967276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770fc82-4931-47c6-b30c-0585f56e4531 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:47.967614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5f32-6b6b-4e34-ac28-3808f367e35c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:47.967892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5f32-6b6b-4e34-ac28-3808f367e35c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:47.968163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5f32-6b6b-4e34-ac28-3808f367e35c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:48.080459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770fc82-4931-47c6-b30c-0585f56e4531 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:48.114358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:48.120724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa050e8-e722-4686-b55e-bab12ffbed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:48.121396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa050e8-e722-4686-b55e-bab12ffbed3e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:48.121684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa050e8-e722-4686-b55e-bab12ffbed3e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:48.122065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa050e8-e722-4686-b55e-bab12ffbed3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:48.133354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa050e8-e722-4686-b55e-bab12ffbed3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:48.135036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa050e8-e722-4686-b55e-bab12ffbed3e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-afa050e8-e722-4686-b55e-bab12ffbed3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:48.151685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:48.152714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:48.154442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:48.154442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:48.154442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:48.154442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 242/498] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:48.158698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa050e8-e722-4686-b55e-bab12ffbed3e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:48.159566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b5f32-6b6b-4e34-ac28-3808f367e35c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:48.161081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b5f32-6b6b-4e34-ac28-3808f367e35c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:48.282993 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:48.286117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa050e8-e722-4686-b55e-bab12ffbed3e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:48.332755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6b4da-c2e8-4ba2-8566-ec05850772bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:48.333798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6b4da-c2e8-4ba2-8566-ec05850772bf None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:48.334311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6b4da-c2e8-4ba2-8566-ec05850772bf None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:48.334788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6b4da-c2e8-4ba2-8566-ec05850772bf None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:48.336570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6b4da-c2e8-4ba2-8566-ec05850772bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:48.342619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6b4da-c2e8-4ba2-8566-ec05850772bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:48.344416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6b4da-c2e8-4ba2-8566-ec05850772bf None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:48.371328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 243/499] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:48.377703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6b4da-c2e8-4ba2-8566-ec05850772bf None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:48.409505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 257/500] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:14:48.416082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5f32-6b6b-4e34-ac28-3808f367e35c None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:48.471702 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:48.544607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5f32-6b6b-4e34-ac28-3808f367e35c None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:48.548700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6b4da-c2e8-4ba2-8566-ec05850772bf None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:48.579291 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5eb1d-f752-44ad-9cf3-2ab28c77103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:48.579912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5eb1d-f752-44ad-9cf3-2ab28c77103c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:48.580182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5eb1d-f752-44ad-9cf3-2ab28c77103c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:48.580447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5eb1d-f752-44ad-9cf3-2ab28c77103c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:48.587390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7acc0-5b3e-42b2-89b6-d0f18729b69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:48.588073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7acc0-5b3e-42b2-89b6-d0f18729b69c None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:48.588421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7acc0-5b3e-42b2-89b6-d0f18729b69c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:48.588883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7acc0-5b3e-42b2-89b6-d0f18729b69c None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:48.589621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7acc0-5b3e-42b2-89b6-d0f18729b69c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:48.590745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5eb1d-f752-44ad-9cf3-2ab28c77103c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:48.591178 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7acc0-5b3e-42b2-89b6-d0f18729b69c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:48.592414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5eb1d-f752-44ad-9cf3-2ab28c77103c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:48.600955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-36f5eb1d-f752-44ad-9cf3-2ab28c77103c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:48.609047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:48.610635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:48.611667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:48.611667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:48.611667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:48.613610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 258/501] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:48.614896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8980371-e00b-4504-80e6-d0568466d665 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:48.615250 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8980371-e00b-4504-80e6-d0568466d665 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:48.615604 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8980371-e00b-4504-80e6-d0568466d665 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:48.621177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 259/502] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:48.622057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8980371-e00b-4504-80e6-d0568466d665 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:48.625221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 244/503] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:14:48 2022] POST /identity/v3/users => generated 254 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:48.626722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c82847-96bb-4fec-83b1-3ea1e2fe2450 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:48.627177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c82847-96bb-4fec-83b1-3ea1e2fe2450 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:48.627619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c82847-96bb-4fec-83b1-3ea1e2fe2450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:48.650942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-32c82847-96bb-4fec-83b1-3ea1e2fe2450 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:48.652597 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-32c82847-96bb-4fec-83b1-3ea1e2fe2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:48.739476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 245/504] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:48.828929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8980371-e00b-4504-80e6-d0568466d665 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:48.867450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b314da4-53d6-42c9-9966-d2aa8fadc3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:48.868204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b314da4-53d6-42c9-9966-d2aa8fadc3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:48.868311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b314da4-53d6-42c9-9966-d2aa8fadc3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:48.868560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b314da4-53d6-42c9-9966-d2aa8fadc3a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:48.869222 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b314da4-53d6-42c9-9966-d2aa8fadc3a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:48.869519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b314da4-53d6-42c9-9966-d2aa8fadc3a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:48.870877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b314da4-53d6-42c9-9966-d2aa8fadc3a5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:48.883441 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 260/505] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:48.889411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c82847-96bb-4fec-83b1-3ea1e2fe2450 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:48.925186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:49.007033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c82847-96bb-4fec-83b1-3ea1e2fe2450 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:49.042601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943b21e-7a10-4826-b2f7-e2dbac61309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:49.043233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943b21e-7a10-4826-b2f7-e2dbac61309e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:49.043510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943b21e-7a10-4826-b2f7-e2dbac61309e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:49.043783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943b21e-7a10-4826-b2f7-e2dbac61309e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:49.050691 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943b21e-7a10-4826-b2f7-e2dbac61309e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:49.052139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943b21e-7a10-4826-b2f7-e2dbac61309e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d943b21e-7a10-4826-b2f7-e2dbac61309e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:49.063880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:49.065901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:49.067084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:49.067084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:49.067084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:49.067084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:49.067084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:49.067084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:49.067084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:49.067084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:49.067084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 246/506] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:49.070995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b314da4-53d6-42c9-9966-d2aa8fadc3a5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:49.118183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943b21e-7a10-4826-b2f7-e2dbac61309e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:49.161992 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:49.215356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:49.229480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943b21e-7a10-4826-b2f7-e2dbac61309e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:49.267324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5620c8-a18e-439d-90b2-544a38c15d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:49.268336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5620c8-a18e-439d-90b2-544a38c15d49 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:49.268821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5620c8-a18e-439d-90b2-544a38c15d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:49.269352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5620c8-a18e-439d-90b2-544a38c15d49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:49.275528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b314da4-53d6-42c9-9966-d2aa8fadc3a5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:49.280935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5620c8-a18e-439d-90b2-544a38c15d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-6c5620c8-a18e-439d-90b2-544a38c15d49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:49.286719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:49.288094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:49.289605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:49.292555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 247/507] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:14:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:49.301591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5620c8-a18e-439d-90b2-544a38c15d49 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:49.384872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dade7-cd26-4523-bea9-b5733442e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:49.385445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dade7-cd26-4523-bea9-b5733442e9de None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:49.385723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dade7-cd26-4523-bea9-b5733442e9de None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:49.385988 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dade7-cd26-4523-bea9-b5733442e9de None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:49.386683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dade7-cd26-4523-bea9-b5733442e9de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:49.386985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dade7-cd26-4523-bea9-b5733442e9de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:49.388522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dade7-cd26-4523-bea9-b5733442e9de None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:49.410507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5620c8-a18e-439d-90b2-544a38c15d49 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:49.418975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 261/508] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:49.428300 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dade7-cd26-4523-bea9-b5733442e9de None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:49.447922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030c0b2-6a93-4acd-89cc-a02ded7d1abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:49.448919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030c0b2-6a93-4acd-89cc-a02ded7d1abc None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:49.449547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030c0b2-6a93-4acd-89cc-a02ded7d1abc None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:49.450046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030c0b2-6a93-4acd-89cc-a02ded7d1abc None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:49.450926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030c0b2-6a93-4acd-89cc-a02ded7d1abc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:49.451434 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030c0b2-6a93-4acd-89cc-a02ded7d1abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:49.453162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030c0b2-6a93-4acd-89cc-a02ded7d1abc None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:49.462622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 248/509] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:49.473814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030c0b2-6a93-4acd-89cc-a02ded7d1abc None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:49.505409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:49.578126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dade7-cd26-4523-bea9-b5733442e9de None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:49.599071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:49.631395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48970d4e-6477-46d3-8907-6ef869357e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:49.635573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970d4e-6477-46d3-8907-6ef869357e97 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:49.636070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970d4e-6477-46d3-8907-6ef869357e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:49.636544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970d4e-6477-46d3-8907-6ef869357e97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:49.637520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48970d4e-6477-46d3-8907-6ef869357e97 None admin] RBAC: Adding query filter params (role.id=f6ee9e8014884bc5aff06380618f6aa2, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=d80d3e8c42ab4942b32618db3f19dd88) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:49.638051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48970d4e-6477-46d3-8907-6ef869357e97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:49.640633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48970d4e-6477-46d3-8907-6ef869357e97 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:49.652371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 262/510] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:14:49 2022] GET /identity/v3/role_assignments?user.id=d80d3e8c42ab4942b32618db3f19dd88&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=f6ee9e8014884bc5aff06380618f6aa2 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:49.659832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030c0b2-6a93-4acd-89cc-a02ded7d1abc None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:49.702836 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9396-cad8-42a6-b6e2-852f30204ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:49.703858 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9396-cad8-42a6-b6e2-852f30204ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:49.704343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9396-cad8-42a6-b6e2-852f30204ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:49.704838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9396-cad8-42a6-b6e2-852f30204ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:49.718839 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9396-cad8-42a6-b6e2-852f30204ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:49.720812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9396-cad8-42a6-b6e2-852f30204ba8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-df8d9396-cad8-42a6-b6e2-852f30204ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:49.736401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:49.737458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:49.738386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:49.738386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:49.738386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:49.740605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 249/511] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:49.746805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48970d4e-6477-46d3-8907-6ef869357e97 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:49.813321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020901f3-419f-43f5-a506-75df69dfa2f8 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:49.813954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020901f3-419f-43f5-a506-75df69dfa2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:49.814472 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020901f3-419f-43f5-a506-75df69dfa2f8 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:49.816065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 250/512] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:49.821892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3d396-1189-4b14-902b-68bde544f565 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:49.822200 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3d396-1189-4b14-902b-68bde544f565 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:49.822438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3d396-1189-4b14-902b-68bde544f565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:49.854849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7ff3d396-1189-4b14-902b-68bde544f565 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:49.856233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7ff3d396-1189-4b14-902b-68bde544f565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:49.922487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48970d4e-6477-46d3-8907-6ef869357e97 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:49.960594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:49.961386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f6d5-2211-41ca-8c76-2bf28c23d627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:49.962334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f6d5-2211-41ca-8c76-2bf28c23d627 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:49.962334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f6d5-2211-41ca-8c76-2bf28c23d627 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:49.962524 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f6d5-2211-41ca-8c76-2bf28c23d627 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:49.964172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10f6d5-2211-41ca-8c76-2bf28c23d627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:49.964172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10f6d5-2211-41ca-8c76-2bf28c23d627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:49.965491 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10f6d5-2211-41ca-8c76-2bf28c23d627 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:49.976764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 251/513] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:49.983998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 263/514] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:49.989645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3d396-1189-4b14-902b-68bde544f565 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:50.003732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49182c9-a7b1-4e97-bc5a-8eea1befdfd7 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:50.004023 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49182c9-a7b1-4e97-bc5a-8eea1befdfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:50.004268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49182c9-a7b1-4e97-bc5a-8eea1befdfd7 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:50.005858 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 264/515] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:14:50.012124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cac8d3-4f03-41c0-bfd1-725c6a7addd3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:50.012403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cac8d3-4f03-41c0-bfd1-725c6a7addd3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:50.012776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cac8d3-4f03-41c0-bfd1-725c6a7addd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:50.032141 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-57cac8d3-4f03-41c0-bfd1-725c6a7addd3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:50.033473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-57cac8d3-4f03-41c0-bfd1-725c6a7addd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:50.082002 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:50.113773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 265/516] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:50.119240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3d396-1189-4b14-902b-68bde544f565 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:50.154584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced0fe-ffd0-46c8-802e-90722c7ae512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:50.155214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced0fe-ffd0-46c8-802e-90722c7ae512 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:50.155487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced0fe-ffd0-46c8-802e-90722c7ae512 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:50.155808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced0fe-ffd0-46c8-802e-90722c7ae512 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:50.162971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbced0fe-ffd0-46c8-802e-90722c7ae512 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:50.164938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbced0fe-ffd0-46c8-802e-90722c7ae512 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-dbced0fe-ffd0-46c8-802e-90722c7ae512 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:50.177591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:50.178512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:50.179524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 252/517] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 07:14:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:50.184421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cac8d3-4f03-41c0-bfd1-725c6a7addd3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:50.262806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced0fe-ffd0-46c8-802e-90722c7ae512 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:50.302958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cac8d3-4f03-41c0-bfd1-725c6a7addd3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:50.353411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:50.372088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e086-311b-423c-9b5c-c340a3f2ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:50.372702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e086-311b-423c-9b5c-c340a3f2ff61 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:50.372975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e086-311b-423c-9b5c-c340a3f2ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:50.373270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e086-311b-423c-9b5c-c340a3f2ff61 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:50.373999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786e086-311b-423c-9b5c-c340a3f2ff61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:50.374299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786e086-311b-423c-9b5c-c340a3f2ff61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:50.375721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786e086-311b-423c-9b5c-c340a3f2ff61 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:50.413889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 266/518] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 07:14:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:50.420493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e086-311b-423c-9b5c-c340a3f2ff61 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:50.443499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced0fe-ffd0-46c8-802e-90722c7ae512 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:50.462327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:50.488912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391190c6-386c-4e80-8e59-0804a8b17dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:50.489701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391190c6-386c-4e80-8e59-0804a8b17dbb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:50.489979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391190c6-386c-4e80-8e59-0804a8b17dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:50.490249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391190c6-386c-4e80-8e59-0804a8b17dbb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:50.490837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391190c6-386c-4e80-8e59-0804a8b17dbb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:50.492779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391190c6-386c-4e80-8e59-0804a8b17dbb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-391190c6-386c-4e80-8e59-0804a8b17dbb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:50.506426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:50.508220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:50.514297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 253/519] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 2 07:14:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:50.515081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391190c6-386c-4e80-8e59-0804a8b17dbb None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:50.562668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e086-311b-423c-9b5c-c340a3f2ff61 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:50.603276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c82bd-6cf2-43ba-abcf-47f0052a4068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:50.604259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c82bd-6cf2-43ba-abcf-47f0052a4068 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:50.604707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c82bd-6cf2-43ba-abcf-47f0052a4068 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:50.605204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c82bd-6cf2-43ba-abcf-47f0052a4068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:50.616830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391190c6-386c-4e80-8e59-0804a8b17dbb None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:50.618046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c82bd-6cf2-43ba-abcf-47f0052a4068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:50.619750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c82bd-6cf2-43ba-abcf-47f0052a4068 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:50.633397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-ed4c82bd-6cf2-43ba-abcf-47f0052a4068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:50.638081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:50.639009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:50.639891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:50.639891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:50.639891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:50.643888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 267/520] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:50.644732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c82bd-6cf2-43ba-abcf-47f0052a4068 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:50.665319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9ae1c-6934-4aa4-b8c9-4d68c60a78c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:50.666520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ae1c-6934-4aa4-b8c9-4d68c60a78c7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:50.667402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ae1c-6934-4aa4-b8c9-4d68c60a78c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:50.667898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ae1c-6934-4aa4-b8c9-4d68c60a78c7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:50.668677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9ae1c-6934-4aa4-b8c9-4d68c60a78c7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:50.670807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9ae1c-6934-4aa4-b8c9-4d68c60a78c7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-28b9ae1c-6934-4aa4-b8c9-4d68c60a78c7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:50.683672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:50.684630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:14:50.685538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:50.693042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 254/521] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:50 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:50.693042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9ae1c-6934-4aa4-b8c9-4d68c60a78c7 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:50.751210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:50.770312 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c82bd-6cf2-43ba-abcf-47f0052a4068 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:50.809318 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfc6ba-8221-448b-a8f8-56876f724268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:50.809933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfc6ba-8221-448b-a8f8-56876f724268 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:50.810209 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfc6ba-8221-448b-a8f8-56876f724268 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:50.810479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfc6ba-8221-448b-a8f8-56876f724268 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:50.811106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfc6ba-8221-448b-a8f8-56876f724268 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:50.811406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfc6ba-8221-448b-a8f8-56876f724268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:50.812791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfc6ba-8221-448b-a8f8-56876f724268 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:50.822789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 268/522] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 07:14:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:50.823717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfc6ba-8221-448b-a8f8-56876f724268 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:50.827579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9ae1c-6934-4aa4-b8c9-4d68c60a78c7 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:50.876008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e092d3f-564d-4d5f-b84e-a7fbaf40c441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:50.877419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e092d3f-564d-4d5f-b84e-a7fbaf40c441 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:50.878151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e092d3f-564d-4d5f-b84e-a7fbaf40c441 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:50.878646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e092d3f-564d-4d5f-b84e-a7fbaf40c441 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:50.879664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e092d3f-564d-4d5f-b84e-a7fbaf40c441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:50.880467 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e092d3f-564d-4d5f-b84e-a7fbaf40c441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:50.882087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e092d3f-564d-4d5f-b84e-a7fbaf40c441 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:50.899565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 255/523] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:50.900795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e092d3f-564d-4d5f-b84e-a7fbaf40c441 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:50.949768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfc6ba-8221-448b-a8f8-56876f724268 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:50.952105 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:51.003212 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6a6b2-cde4-4aa6-a03a-e9f66fabd651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:51.003744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6a6b2-cde4-4aa6-a03a-e9f66fabd651 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:51.004415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6a6b2-cde4-4aa6-a03a-e9f66fabd651 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:51.004415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6a6b2-cde4-4aa6-a03a-e9f66fabd651 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:51.005035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6a6b2-cde4-4aa6-a03a-e9f66fabd651 None admin] RBAC: Adding query filter params (name=network) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:51.005349 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6a6b2-cde4-4aa6-a03a-e9f66fabd651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:51.006833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6a6b2-cde4-4aa6-a03a-e9f66fabd651 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:51.017210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 269/524] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:14:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:51.017210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6a6b2-cde4-4aa6-a03a-e9f66fabd651 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:51.036321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e092d3f-564d-4d5f-b84e-a7fbaf40c441 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:51.037581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:51.076898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a083c2-7a23-4ba1-8576-853601e1d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:51.077649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a083c2-7a23-4ba1-8576-853601e1d829 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:51.077931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a083c2-7a23-4ba1-8576-853601e1d829 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:51.078200 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a083c2-7a23-4ba1-8576-853601e1d829 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:51.078832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a083c2-7a23-4ba1-8576-853601e1d829 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:51.079154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a083c2-7a23-4ba1-8576-853601e1d829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:51.080611 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a083c2-7a23-4ba1-8576-853601e1d829 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:51.093350 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 256/525] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 07:14:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:51.094449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a083c2-7a23-4ba1-8576-853601e1d829 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:51.144259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6a6b2-cde4-4aa6-a03a-e9f66fabd651 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:51.186515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846aabd-4b82-4db5-b8ef-b141cc10e477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:51.187721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846aabd-4b82-4db5-b8ef-b141cc10e477 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:51.188262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846aabd-4b82-4db5-b8ef-b141cc10e477 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:51.188771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846aabd-4b82-4db5-b8ef-b141cc10e477 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:51.198149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846aabd-4b82-4db5-b8ef-b141cc10e477 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:51.200643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846aabd-4b82-4db5-b8ef-b141cc10e477 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-8846aabd-4b82-4db5-b8ef-b141cc10e477 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:51.215149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:51.216166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:51.217330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:51.217330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:51.217330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:51.217330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:51.217330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:51.217330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:51.217330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:51.217330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:51.220507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 270/526] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:51.226134 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846aabd-4b82-4db5-b8ef-b141cc10e477 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:51.297874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a083c2-7a23-4ba1-8576-853601e1d829 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:51.301797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:51.335973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da3853-ed9f-464e-8654-7347f38d981b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:51.336832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da3853-ed9f-464e-8654-7347f38d981b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:51.337301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da3853-ed9f-464e-8654-7347f38d981b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:51.337714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da3853-ed9f-464e-8654-7347f38d981b None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:51.338491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da3853-ed9f-464e-8654-7347f38d981b None admin] RBAC: Adding query filter params (type=network) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:51.338955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da3853-ed9f-464e-8654-7347f38d981b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:51.340481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da3853-ed9f-464e-8654-7347f38d981b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:51.346512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 257/527] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:14:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:51.356417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:51.396552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846aabd-4b82-4db5-b8ef-b141cc10e477 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:51.440707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b446479-8c44-48a0-be57-cca15051059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:51.441656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b446479-8c44-48a0-be57-cca15051059c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:51.442103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b446479-8c44-48a0-be57-cca15051059c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:51.442538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b446479-8c44-48a0-be57-cca15051059c None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:51.443421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b446479-8c44-48a0-be57-cca15051059c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:51.443885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b446479-8c44-48a0-be57-cca15051059c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:51.446099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b446479-8c44-48a0-be57-cca15051059c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:51.465462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 271/528] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:51.471948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da3853-ed9f-464e-8654-7347f38d981b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:51.502767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef12f7-9bb1-49b3-a126-142db8907d5b None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:51.503099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef12f7-9bb1-49b3-a126-142db8907d5b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:51.503310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef12f7-9bb1-49b3-a126-142db8907d5b None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:51.504809 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 272/529] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:14:51.512213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e697a-001e-4474-88b6-790193f6d39e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:51.512558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e697a-001e-4474-88b6-790193f6d39e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:51.512757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e697a-001e-4474-88b6-790193f6d39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:51.541876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a96e697a-001e-4474-88b6-790193f6d39e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:51.543104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a96e697a-001e-4474-88b6-790193f6d39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:51.620542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 273/530] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:14:51.626865 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da3853-ed9f-464e-8654-7347f38d981b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:51.662682 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427713-0ddb-4b3a-b5db-e9452aeede77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:51.663411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427713-0ddb-4b3a-b5db-e9452aeede77 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:51.664248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427713-0ddb-4b3a-b5db-e9452aeede77 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:51.664533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc427713-0ddb-4b3a-b5db-e9452aeede77 None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/ad0826bb58db4100b0d807fb07734deb/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:51.666500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc427713-0ddb-4b3a-b5db-e9452aeede77 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=ad0826bb58db4100b0d807fb07734deb, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:51.667931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc427713-0ddb-4b3a-b5db-e9452aeede77 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:51.683577 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 258/531] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:14:51 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/ad0826bb58db4100b0d807fb07734deb/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:52.005603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e697a-001e-4474-88b6-790193f6d39e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:52.085689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:52.133308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e697a-001e-4474-88b6-790193f6d39e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:52.190049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab005d0-015b-406c-8a5a-f4d5db99deee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:52.191015 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab005d0-015b-406c-8a5a-f4d5db99deee None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:52.191509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab005d0-015b-406c-8a5a-f4d5db99deee None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:52.191973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab005d0-015b-406c-8a5a-f4d5db99deee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:52.212421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab005d0-015b-406c-8a5a-f4d5db99deee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-cab005d0-015b-406c-8a5a-f4d5db99deee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:52.217959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:52.218900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:52.219745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:52.222121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 274/532] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:52.231583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427713-0ddb-4b3a-b5db-e9452aeede77 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:52.308962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:52.371729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240cde-e526-48b5-bb22-6fedd2cc5440 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:52.372408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240cde-e526-48b5-bb22-6fedd2cc5440 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:52.372880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240cde-e526-48b5-bb22-6fedd2cc5440 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:52.374770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 275/533] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:52.380497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb58d58-3863-496f-8972-13dc33fe46ce None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:52.380809 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb58d58-3863-496f-8972-13dc33fe46ce None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:52.381059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb58d58-3863-496f-8972-13dc33fe46ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:52.415105 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc427713-0ddb-4b3a-b5db-e9452aeede77 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:52.431872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-eeb58d58-3863-496f-8972-13dc33fe46ce None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:52.433365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-eeb58d58-3863-496f-8972-13dc33fe46ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:52.452906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442d97b-bb89-4b43-bfe0-f916f0c1aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:52.453999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d97b-bb89-4b43-bfe0-f916f0c1aca2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:52.454576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d97b-bb89-4b43-bfe0-f916f0c1aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:52.455154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442d97b-bb89-4b43-bfe0-f916f0c1aca2 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:52.456471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442d97b-bb89-4b43-bfe0-f916f0c1aca2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:52.457147 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442d97b-bb89-4b43-bfe0-f916f0c1aca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:52.459935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442d97b-bb89-4b43-bfe0-f916f0c1aca2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:52.470572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 259/534] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:52.476881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442d97b-bb89-4b43-bfe0-f916f0c1aca2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:52.580069 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:52.593683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442d97b-bb89-4b43-bfe0-f916f0c1aca2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:52.635213 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e93a2-50f4-4a59-8d57-0a01a926ada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:52.635862 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e93a2-50f4-4a59-8d57-0a01a926ada9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:52.636139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e93a2-50f4-4a59-8d57-0a01a926ada9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:52.636411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e93a2-50f4-4a59-8d57-0a01a926ada9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:52.637762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 276/535] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:52.649734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e93a2-50f4-4a59-8d57-0a01a926ada9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:52.651266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e93a2-50f4-4a59-8d57-0a01a926ada9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-f42e93a2-50f4-4a59-8d57-0a01a926ada9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:52.667875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:52.668875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:52.670216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:52.670216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:52.670216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:52.670216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 260/536] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:52.675825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb58d58-3863-496f-8972-13dc33fe46ce None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:52.741770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:52.797627 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb58d58-3863-496f-8972-13dc33fe46ce None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:52.834344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791850e-08e5-4308-9d02-2de7956d2355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:52.835404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791850e-08e5-4308-9d02-2de7956d2355 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:52.836438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791850e-08e5-4308-9d02-2de7956d2355 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:52.836730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791850e-08e5-4308-9d02-2de7956d2355 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:52.837415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791850e-08e5-4308-9d02-2de7956d2355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:52.837720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791850e-08e5-4308-9d02-2de7956d2355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:52.839098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791850e-08e5-4308-9d02-2de7956d2355 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:52.852600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 277/537] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:52.858053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e93a2-50f4-4a59-8d57-0a01a926ada9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:52.977644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e93a2-50f4-4a59-8d57-0a01a926ada9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:53.011877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791850e-08e5-4308-9d02-2de7956d2355 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:53.024868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c921c24-70a4-4b50-9f5f-fd47dfcf8d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:53.025540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c921c24-70a4-4b50-9f5f-fd47dfcf8d6a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:53.025813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c921c24-70a4-4b50-9f5f-fd47dfcf8d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:53.026080 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c921c24-70a4-4b50-9f5f-fd47dfcf8d6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:53.046601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c921c24-70a4-4b50-9f5f-fd47dfcf8d6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:53.048455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c921c24-70a4-4b50-9f5f-fd47dfcf8d6a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:53.058562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1c921c24-70a4-4b50-9f5f-fd47dfcf8d6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:53.074785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:53.075874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:53.077299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 261/538] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 07:14:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:53.084908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c921c24-70a4-4b50-9f5f-fd47dfcf8d6a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:53.137733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791850e-08e5-4308-9d02-2de7956d2355 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:53.169566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:53.181722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c48e8a-9551-49cd-b36c-234156d3cfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:53.183087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c48e8a-9551-49cd-b36c-234156d3cfea None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:53.188644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c48e8a-9551-49cd-b36c-234156d3cfea None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:53.188644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c48e8a-9551-49cd-b36c-234156d3cfea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:53.217643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c48e8a-9551-49cd-b36c-234156d3cfea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d1c48e8a-9551-49cd-b36c-234156d3cfea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:53.222633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:53.223659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:53.224518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:53.235017 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 278/539] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:14:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:53.238058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c48e8a-9551-49cd-b36c-234156d3cfea None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:53.301529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c921c24-70a4-4b50-9f5f-fd47dfcf8d6a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:53.387839 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c48e8a-9551-49cd-b36c-234156d3cfea None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:53.391534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046d79b-0dc8-4ae7-9044-cad99f134ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:53.392377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d79b-0dc8-4ae7-9044-cad99f134ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:53.392832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d79b-0dc8-4ae7-9044-cad99f134ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:53.393296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046d79b-0dc8-4ae7-9044-cad99f134ac2 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:53.394235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046d79b-0dc8-4ae7-9044-cad99f134ac2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:53.394720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046d79b-0dc8-4ae7-9044-cad99f134ac2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:53.396362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046d79b-0dc8-4ae7-9044-cad99f134ac2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:53.428558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fd190-6fbc-41f8-a9d6-9331509aadef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:53.429579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fd190-6fbc-41f8-a9d6-9331509aadef None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:53.431522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fd190-6fbc-41f8-a9d6-9331509aadef None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:53.432142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fd190-6fbc-41f8-a9d6-9331509aadef None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:53.434228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 262/540] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Nov 2 07:14:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:53.435168 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fd190-6fbc-41f8-a9d6-9331509aadef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:53.435730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fd190-6fbc-41f8-a9d6-9331509aadef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:53.437391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fd190-6fbc-41f8-a9d6-9331509aadef None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:53.439786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046d79b-0dc8-4ae7-9044-cad99f134ac2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:53.455284 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 279/541] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:53.458873 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fd190-6fbc-41f8-a9d6-9331509aadef None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:53.497637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:53.554894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:53.591028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fd190-6fbc-41f8-a9d6-9331509aadef None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:53.636137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046d79b-0dc8-4ae7-9044-cad99f134ac2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:53.655376 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a389-6800-4463-a985-d0f8645c039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:53.656004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a389-6800-4463-a985-d0f8645c039d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:53.656273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a389-6800-4463-a985-d0f8645c039d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:53.656535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a389-6800-4463-a985-d0f8645c039d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:53.676777 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8a389-6800-4463-a985-d0f8645c039d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:53.678588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8a389-6800-4463-a985-d0f8645c039d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-05c8a389-6800-4463-a985-d0f8645c039d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:53.705003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:53.706075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:53.706953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:53.706953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:53.706953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:53.707123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e15133-1120-451f-b17f-f5a24874f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:53.707123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e15133-1120-451f-b17f-f5a24874f6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:53.707123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e15133-1120-451f-b17f-f5a24874f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:53.707123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e15133-1120-451f-b17f-f5a24874f6d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:53.710895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 280/542] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:53.717059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a389-6800-4463-a985-d0f8645c039d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:53.721826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e15133-1120-451f-b17f-f5a24874f6d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:53.723285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e15133-1120-451f-b17f-f5a24874f6d6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-85e15133-1120-451f-b17f-f5a24874f6d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:53.760463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:53.761502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:53.764195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:53.764195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:53.764195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:53.764195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 263/543] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:53.767061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e15133-1120-451f-b17f-f5a24874f6d6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:53.896255 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:53.927892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a389-6800-4463-a985-d0f8645c039d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:53.947844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e15133-1120-451f-b17f-f5a24874f6d6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:53.969800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:53.975680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c6755-ee41-4271-813c-c7f42f8d4347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:53.976941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c6755-ee41-4271-813c-c7f42f8d4347 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:53.977255 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c6755-ee41-4271-813c-c7f42f8d4347 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:53.977466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c6755-ee41-4271-813c-c7f42f8d4347 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:53.978106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c6755-ee41-4271-813c-c7f42f8d4347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:53.978476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c6755-ee41-4271-813c-c7f42f8d4347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:53.981045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c6755-ee41-4271-813c-c7f42f8d4347 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:53.993927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 281/544] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:54.000392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c6755-ee41-4271-813c-c7f42f8d4347 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:54.025519 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819622ed-eded-4b3f-bd1e-a2f2039762b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:54.026125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819622ed-eded-4b3f-bd1e-a2f2039762b4 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.026397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819622ed-eded-4b3f-bd1e-a2f2039762b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.026666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819622ed-eded-4b3f-bd1e-a2f2039762b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.027299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819622ed-eded-4b3f-bd1e-a2f2039762b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:54.027595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819622ed-eded-4b3f-bd1e-a2f2039762b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:54.028945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819622ed-eded-4b3f-bd1e-a2f2039762b4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:54.050863 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 264/545] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:54.057130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819622ed-eded-4b3f-bd1e-a2f2039762b4 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:54.152094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c6755-ee41-4271-813c-c7f42f8d4347 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:54.191615 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e1a72-aa14-4dcd-8c77-1d7d4d7f5455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:54.192600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e1a72-aa14-4dcd-8c77-1d7d4d7f5455 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.193130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e1a72-aa14-4dcd-8c77-1d7d4d7f5455 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.193621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e1a72-aa14-4dcd-8c77-1d7d4d7f5455 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.199394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819622ed-eded-4b3f-bd1e-a2f2039762b4 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:54.203108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e1a72-aa14-4dcd-8c77-1d7d4d7f5455 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:54.204785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e1a72-aa14-4dcd-8c77-1d7d4d7f5455 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-ea0e1a72-aa14-4dcd-8c77-1d7d4d7f5455 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:54.220418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:54.221544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:54.222492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:54.222492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:54.222492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:54.222492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:54.222492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:54.222492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:54.222492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:54.222492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:54.222492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:14:54.222492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:54.225097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 282/546] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:14:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:54.227924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61adf-ead0-4e30-9d27-45d2209c5290 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.228223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61adf-ead0-4e30-9d27-45d2209c5290 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.228469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb61adf-ead0-4e30-9d27-45d2209c5290 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.232017 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 283/547] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:54.232017 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61adf-ead0-4e30-9d27-45d2209c5290 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:54.245617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:54.258747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b032a5-c137-432e-9911-fae42a1d5b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:54.260354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b032a5-c137-432e-9911-fae42a1d5b8c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.260875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b032a5-c137-432e-9911-fae42a1d5b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.261368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b032a5-c137-432e-9911-fae42a1d5b8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.271692 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b032a5-c137-432e-9911-fae42a1d5b8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:54.274336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b032a5-c137-432e-9911-fae42a1d5b8c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e0b032a5-c137-432e-9911-fae42a1d5b8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:54.289486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:54.290438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:54.291317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:54.291317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:54.291317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:54.291317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:54.291317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:54.291317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:54.291317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:54.291317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:54.291317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 265/548] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:54.293223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129baeb-ba81-43c1-8fd7-bf8bc07f0eb1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.293569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129baeb-ba81-43c1-8fd7-bf8bc07f0eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.293948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129baeb-ba81-43c1-8fd7-bf8bc07f0eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.314425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9129baeb-ba81-43c1-8fd7-bf8bc07f0eb1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:54.316057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9129baeb-ba81-43c1-8fd7-bf8bc07f0eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:54.342643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:54.372007 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb61adf-ead0-4e30-9d27-45d2209c5290 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:54.395000 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 266/549] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:54.395840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129baeb-ba81-43c1-8fd7-bf8bc07f0eb1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:54.411643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d63ddd-0193-4195-9dd6-3141376f4838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:54.412508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63ddd-0193-4195-9dd6-3141376f4838 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.412998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63ddd-0193-4195-9dd6-3141376f4838 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.413491 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63ddd-0193-4195-9dd6-3141376f4838 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.414781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d63ddd-0193-4195-9dd6-3141376f4838 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:54.415297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d63ddd-0193-4195-9dd6-3141376f4838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:54.416905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d63ddd-0193-4195-9dd6-3141376f4838 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:54.436700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 284/550] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 07:14:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:54.438326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c552f9-8344-4cd3-9d94-a60a5074cfec None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.438679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c552f9-8344-4cd3-9d94-a60a5074cfec None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.439028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c552f9-8344-4cd3-9d94-a60a5074cfec None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.440497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 285/551] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:54.441408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0080d7-9055-42e9-804f-0bcdcee36d56 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.441776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0080d7-9055-42e9-804f-0bcdcee36d56 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.442054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0080d7-9055-42e9-804f-0bcdcee36d56 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.445580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 286/552] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:54.445580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0080d7-9055-42e9-804f-0bcdcee36d56 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:54.506123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129baeb-ba81-43c1-8fd7-bf8bc07f0eb1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:54.516920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:54.547785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf76f95-d846-4d7c-8799-f4f391a0458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:54.548497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf76f95-d846-4d7c-8799-f4f391a0458d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.548783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf76f95-d846-4d7c-8799-f4f391a0458d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.549064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf76f95-d846-4d7c-8799-f4f391a0458d None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.549749 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf76f95-d846-4d7c-8799-f4f391a0458d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:54.550053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf76f95-d846-4d7c-8799-f4f391a0458d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:54.551485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf76f95-d846-4d7c-8799-f4f391a0458d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:54.560709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0080d7-9055-42e9-804f-0bcdcee36d56 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:54.568946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 267/553] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:54.568946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af16e-e1c8-4159-a994-df11d93ba0df None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.568946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af16e-e1c8-4159-a994-df11d93ba0df None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.568946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af16e-e1c8-4159-a994-df11d93ba0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.587254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-154af16e-e1c8-4159-a994-df11d93ba0df None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:54.588568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-154af16e-e1c8-4159-a994-df11d93ba0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:54.598790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0be36f-5711-4564-8538-4b4275079d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:54.599418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0be36f-5711-4564-8538-4b4275079d7d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.599690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0be36f-5711-4564-8538-4b4275079d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.599958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0be36f-5711-4564-8538-4b4275079d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.604552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:54.611546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0be36f-5711-4564-8538-4b4275079d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:54.612980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0be36f-5711-4564-8538-4b4275079d7d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0a0be36f-5711-4564-8538-4b4275079d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:54.628672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:54.629836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:54.630734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:54.630734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:54.630734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:54.634953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 287/554] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:54.636239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d8d80-9a3e-418b-9096-410cd57fa2b0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.636515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d8d80-9a3e-418b-9096-410cd57fa2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.636781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d8d80-9a3e-418b-9096-410cd57fa2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.655441 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ec8d8d80-9a3e-418b-9096-410cd57fa2b0 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:54.656638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ec8d8d80-9a3e-418b-9096-410cd57fa2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:54.661111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 268/555] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:54.662156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af16e-e1c8-4159-a994-df11d93ba0df None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:54.727097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 288/556] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:14:54.728303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d8d80-9a3e-418b-9096-410cd57fa2b0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:54.793112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:54.804679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af16e-e1c8-4159-a994-df11d93ba0df None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:54.855345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6134e-eb23-40ff-b01a-b39078630684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:54.856988 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6134e-eb23-40ff-b01a-b39078630684 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.857791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6134e-eb23-40ff-b01a-b39078630684 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.858274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6134e-eb23-40ff-b01a-b39078630684 None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/e27f655402804b439fb23a3a983a1c5a/roles/f6ee9e8014884bc5aff06380618f6aa2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.859385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d8d80-9a3e-418b-9096-410cd57fa2b0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:54.881206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6134e-eb23-40ff-b01a-b39078630684 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=e27f655402804b439fb23a3a983a1c5a, role_id=f6ee9e8014884bc5aff06380618f6aa2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:54.884086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6134e-eb23-40ff-b01a-b39078630684 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:54.894486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f1a13-e33a-4de1-8206-fce2dce442a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:54.895090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f1a13-e33a-4de1-8206-fce2dce442a6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:54.895363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f1a13-e33a-4de1-8206-fce2dce442a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:54.895624 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f1a13-e33a-4de1-8206-fce2dce442a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:54.896322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f1a13-e33a-4de1-8206-fce2dce442a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:54.896622 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f1a13-e33a-4de1-8206-fce2dce442a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:54.897526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:54.898724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f1a13-e33a-4de1-8206-fce2dce442a6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:54.904123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 269/557] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:14:54 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/e27f655402804b439fb23a3a983a1c5a/roles/f6ee9e8014884bc5aff06380618f6aa2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:54.906669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6134e-eb23-40ff-b01a-b39078630684 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:54.940201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 289/558] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:54.941289 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f1a13-e33a-4de1-8206-fce2dce442a6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:55.036058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6134e-eb23-40ff-b01a-b39078630684 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:55.076049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f1a13-e33a-4de1-8206-fce2dce442a6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:55.078460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d662e-3963-4f46-8a89-f999bbecb75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:55.079078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d662e-3963-4f46-8a89-f999bbecb75f None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:55.079358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d662e-3963-4f46-8a89-f999bbecb75f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:55.079624 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d662e-3963-4f46-8a89-f999bbecb75f None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:55.080281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d662e-3963-4f46-8a89-f999bbecb75f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:55.081742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d662e-3963-4f46-8a89-f999bbecb75f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:55.084416 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:55.102224 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 270/559] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:14:54 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:55.103064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d662e-3963-4f46-8a89-f999bbecb75f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:55.145882 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71a8a-2039-4b3c-8044-fc4a3de48af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:55.146804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71a8a-2039-4b3c-8044-fc4a3de48af8 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:55.147240 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71a8a-2039-4b3c-8044-fc4a3de48af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:55.147698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71a8a-2039-4b3c-8044-fc4a3de48af8 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:55.148610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a71a8a-2039-4b3c-8044-fc4a3de48af8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:55.151027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a71a8a-2039-4b3c-8044-fc4a3de48af8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:55.176783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 290/560] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:14:54 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:14:55.178748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71a8a-2039-4b3c-8044-fc4a3de48af8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:55.184770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:55.237156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d662e-3963-4f46-8a89-f999bbecb75f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:55.301797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54bc5f-d5b9-4b28-a947-63eb71134a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:55.302461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54bc5f-d5b9-4b28-a947-63eb71134a32 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:55.302736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54bc5f-d5b9-4b28-a947-63eb71134a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:55.303005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54bc5f-d5b9-4b28-a947-63eb71134a32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:55.312168 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54bc5f-d5b9-4b28-a947-63eb71134a32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:55.315307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54bc5f-d5b9-4b28-a947-63eb71134a32 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-7d54bc5f-d5b9-4b28-a947-63eb71134a32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:55.330192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:55.331175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:55.332049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:55.332049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:55.332049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:55.332049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:55.332049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:55.332049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:55.332049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:55.332049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:55.336708 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 271/561] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:55.338180 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54bc5f-d5b9-4b28-a947-63eb71134a32 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:55.364952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71a8a-2039-4b3c-8044-fc4a3de48af8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:55.412010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17328475-2a5c-4b98-b7ec-8078379bd69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:55.413317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17328475-2a5c-4b98-b7ec-8078379bd69a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:55.415836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17328475-2a5c-4b98-b7ec-8078379bd69a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:55.416111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17328475-2a5c-4b98-b7ec-8078379bd69a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:55.431953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17328475-2a5c-4b98-b7ec-8078379bd69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-17328475-2a5c-4b98-b7ec-8078379bd69a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:55.439257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:55.440251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:55.441528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 291/562] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:55.450008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17328475-2a5c-4b98-b7ec-8078379bd69a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:55.473651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54bc5f-d5b9-4b28-a947-63eb71134a32 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:55.482690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:55.492768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:55.514520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2150-9898-4f7e-99b4-4f7d7156f9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:55.515134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2150-9898-4f7e-99b4-4f7d7156f9dc None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:55.515398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2150-9898-4f7e-99b4-4f7d7156f9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:55.515671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2150-9898-4f7e-99b4-4f7d7156f9dc None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:55.516755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b2150-9898-4f7e-99b4-4f7d7156f9dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:55.517084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b2150-9898-4f7e-99b4-4f7d7156f9dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:55.519128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b2150-9898-4f7e-99b4-4f7d7156f9dc None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:55.536570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 272/563] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:55.543650 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2150-9898-4f7e-99b4-4f7d7156f9dc None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:55.593590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17328475-2a5c-4b98-b7ec-8078379bd69a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:55.633054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d8467-eb04-4e74-b827-efbd3e16add3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:55.633668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d8467-eb04-4e74-b827-efbd3e16add3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:55.633945 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d8467-eb04-4e74-b827-efbd3e16add3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:55.634209 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d8467-eb04-4e74-b827-efbd3e16add3 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:55.634866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d8467-eb04-4e74-b827-efbd3e16add3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:55.635161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d8467-eb04-4e74-b827-efbd3e16add3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:55.636705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d8467-eb04-4e74-b827-efbd3e16add3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:55.646535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 292/564] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:55.654094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d8467-eb04-4e74-b827-efbd3e16add3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:55.664759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2150-9898-4f7e-99b4-4f7d7156f9dc None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:55.731301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfd5c4-eb44-4321-a3b6-022f6f5fe50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:55.733585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfd5c4-eb44-4321-a3b6-022f6f5fe50c None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:55.734280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfd5c4-eb44-4321-a3b6-022f6f5fe50c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:55.735429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfd5c4-eb44-4321-a3b6-022f6f5fe50c None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/d80d3e8c42ab4942b32618db3f19dd88/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:55.738436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfd5c4-eb44-4321-a3b6-022f6f5fe50c None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=d80d3e8c42ab4942b32618db3f19dd88, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:55.741530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfd5c4-eb44-4321-a3b6-022f6f5fe50c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:55.766078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 273/565] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:14:55 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/d80d3e8c42ab4942b32618db3f19dd88/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:14:55.799431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:55.818954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d8467-eb04-4e74-b827-efbd3e16add3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:55.867595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f15ebc-1d0b-478f-8b1c-6abc0816ae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:55.868572 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f15ebc-1d0b-478f-8b1c-6abc0816ae6b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:55.869040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f15ebc-1d0b-478f-8b1c-6abc0816ae6b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:55.869528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f15ebc-1d0b-478f-8b1c-6abc0816ae6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:55.886150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f15ebc-1d0b-478f-8b1c-6abc0816ae6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:55.887956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f15ebc-1d0b-478f-8b1c-6abc0816ae6b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-e3f15ebc-1d0b-478f-8b1c-6abc0816ae6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:55.917846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:55.918838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:55.919751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:55.919751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:55.919751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:55.925054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 293/566] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:55.930561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfd5c4-eb44-4321-a3b6-022f6f5fe50c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:55.986138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:56.065240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfd5c4-eb44-4321-a3b6-022f6f5fe50c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:56.101949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02053c-b813-4198-9230-d388a57cc168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:56.102555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02053c-b813-4198-9230-d388a57cc168 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:56.102827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02053c-b813-4198-9230-d388a57cc168 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:56.103095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02053c-b813-4198-9230-d388a57cc168 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:56.103855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02053c-b813-4198-9230-d388a57cc168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:56.104152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02053c-b813-4198-9230-d388a57cc168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:56.105544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02053c-b813-4198-9230-d388a57cc168 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:56.118368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 274/567] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:56.123410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f15ebc-1d0b-478f-8b1c-6abc0816ae6b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:56.236991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f15ebc-1d0b-478f-8b1c-6abc0816ae6b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:56.275669 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865e47d-9890-4b0f-8703-900f1103e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:56.276298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865e47d-9890-4b0f-8703-900f1103e98b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:56.276570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865e47d-9890-4b0f-8703-900f1103e98b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:56.276833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865e47d-9890-4b0f-8703-900f1103e98b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:56.279726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:56.285531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865e47d-9890-4b0f-8703-900f1103e98b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:56.287028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865e47d-9890-4b0f-8703-900f1103e98b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9865e47d-9890-4b0f-8703-900f1103e98b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:56.299059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:56.300053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:56.301734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 294/568] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 07:14:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:14:56.306269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02053c-b813-4198-9230-d388a57cc168 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:56.443835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:56.451509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02053c-b813-4198-9230-d388a57cc168 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:56.487861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6925f-7f2f-4f0d-b37f-32ecc6046c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:56.488745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6925f-7f2f-4f0d-b37f-32ecc6046c5c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:56.489227 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6925f-7f2f-4f0d-b37f-32ecc6046c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:56.489679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6925f-7f2f-4f0d-b37f-32ecc6046c5c None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:56.490610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6925f-7f2f-4f0d-b37f-32ecc6046c5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:56.491092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6925f-7f2f-4f0d-b37f-32ecc6046c5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:56.493283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6925f-7f2f-4f0d-b37f-32ecc6046c5c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:56.512085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 275/569] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 07:14:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:56.518481 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865e47d-9890-4b0f-8703-900f1103e98b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:56.634427 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865e47d-9890-4b0f-8703-900f1103e98b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:56.686584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec343fc7-0c3e-4caa-afce-3027ec353f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:56.687195 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343fc7-0c3e-4caa-afce-3027ec353f3f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:56.687471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343fc7-0c3e-4caa-afce-3027ec353f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:56.687740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343fc7-0c3e-4caa-afce-3027ec353f3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:56.766833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:56.773215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec343fc7-0c3e-4caa-afce-3027ec353f3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:56.774662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec343fc7-0c3e-4caa-afce-3027ec353f3f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:56.884920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 295/570] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:14:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:14:56.890351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6925f-7f2f-4f0d-b37f-32ecc6046c5c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:57.016381 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6925f-7f2f-4f0d-b37f-32ecc6046c5c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:57.052780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd8b7-6152-4df1-90aa-b71b50eeb800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:57.053806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd8b7-6152-4df1-90aa-b71b50eeb800 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:57.054187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd8b7-6152-4df1-90aa-b71b50eeb800 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:57.055181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd8b7-6152-4df1-90aa-b71b50eeb800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:57.065736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cd8b7-6152-4df1-90aa-b71b50eeb800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:57.067294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cd8b7-6152-4df1-90aa-b71b50eeb800 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-070cd8b7-6152-4df1-90aa-b71b50eeb800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:57.082864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:57.084045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:57.085138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:57.085138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:57.085138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:57.087208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 276/571] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:57.095032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec343fc7-0c3e-4caa-afce-3027ec353f3f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:57.254438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:57.260498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec343fc7-0c3e-4caa-afce-3027ec353f3f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:57.307662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12a6b2-e466-419a-9a8f-8b829b871f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:57.308186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12a6b2-e466-419a-9a8f-8b829b871f0d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:57.308462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12a6b2-e466-419a-9a8f-8b829b871f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:57.308730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12a6b2-e466-419a-9a8f-8b829b871f0d None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:57.309398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12a6b2-e466-419a-9a8f-8b829b871f0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:57.309694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12a6b2-e466-419a-9a8f-8b829b871f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:57.311055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12a6b2-e466-419a-9a8f-8b829b871f0d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:57.327811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 296/572] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:57.333321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd8b7-6152-4df1-90aa-b71b50eeb800 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:57.343317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:57.458541 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd8b7-6152-4df1-90aa-b71b50eeb800 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:57.504609 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e972a9e-4a59-469d-9f7f-cd454a6561d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:57.505272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e972a9e-4a59-469d-9f7f-cd454a6561d9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:57.505548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e972a9e-4a59-469d-9f7f-cd454a6561d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:57.505843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e972a9e-4a59-469d-9f7f-cd454a6561d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:57.518357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e972a9e-4a59-469d-9f7f-cd454a6561d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:57.519825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e972a9e-4a59-469d-9f7f-cd454a6561d9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3e972a9e-4a59-469d-9f7f-cd454a6561d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:14:57.531897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:57.532821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:57.533744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:14:57.533744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:14:57.533744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:14:57.533744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:14:57.533744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:14:57.533744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:14:57.533744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:14:57.533744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:57.533744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 277/573] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:57.542147 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12a6b2-e466-419a-9a8f-8b829b871f0d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:57.681318 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12a6b2-e466-419a-9a8f-8b829b871f0d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:57.726947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdaf94-2ef2-475a-82a4-c96e41cc247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:57.727556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdaf94-2ef2-475a-82a4-c96e41cc247e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:57.727836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdaf94-2ef2-475a-82a4-c96e41cc247e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:57.728101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdaf94-2ef2-475a-82a4-c96e41cc247e None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:57.728787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdaf94-2ef2-475a-82a4-c96e41cc247e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:57.729111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdaf94-2ef2-475a-82a4-c96e41cc247e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:57.730522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdaf94-2ef2-475a-82a4-c96e41cc247e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:57.747886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 297/574] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:57.752026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c8ff1-8877-41c0-a7be-3acedacbb977 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:57.752304 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c8ff1-8877-41c0-a7be-3acedacbb977 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:57.752570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c8ff1-8877-41c0-a7be-3acedacbb977 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:57.754115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdaf94-2ef2-475a-82a4-c96e41cc247e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:57.754665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 278/575] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:57.766328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda03bd-941c-42bf-8579-804017836f1d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:57.766608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda03bd-941c-42bf-8579-804017836f1d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:57.766870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda03bd-941c-42bf-8579-804017836f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:57.781342 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:57.818788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2fda03bd-941c-42bf-8579-804017836f1d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:57.820073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2fda03bd-941c-42bf-8579-804017836f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:57.864205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdaf94-2ef2-475a-82a4-c96e41cc247e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:57.908326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6381c5-f03c-47a5-9a91-c1a7385e0019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:57.909137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6381c5-f03c-47a5-9a91-c1a7385e0019 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:57.909511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6381c5-f03c-47a5-9a91-c1a7385e0019 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:57.909876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6381c5-f03c-47a5-9a91-c1a7385e0019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:57.912515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6381c5-f03c-47a5-9a91-c1a7385e0019 None admin] RBAC: Adding query filter params (role.id=6a01757540e64fed9041997458bd64e5, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=ad0826bb58db4100b0d807fb07734deb) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:57.912935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6381c5-f03c-47a5-9a91-c1a7385e0019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:57.914789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6381c5-f03c-47a5-9a91-c1a7385e0019 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:57.921832 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 298/576] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:14:57 2022] GET /identity/v3/role_assignments?user.id=ad0826bb58db4100b0d807fb07734deb&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=6a01757540e64fed9041997458bd64e5 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:57.978276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab697fb-96cc-4a46-884d-0da33012440c None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:57.979079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab697fb-96cc-4a46-884d-0da33012440c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:57.979370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab697fb-96cc-4a46-884d-0da33012440c None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:57.981525 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 299/577] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:14:57.985589 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:57.987424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887291de-e036-47e7-b9e0-c58069dca298 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:57.987715 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887291de-e036-47e7-b9e0-c58069dca298 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:57.987996 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887291de-e036-47e7-b9e0-c58069dca298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:57.999749 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 279/578] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:14:58.021273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-887291de-e036-47e7-b9e0-c58069dca298 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:58.022489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-887291de-e036-47e7-b9e0-c58069dca298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:58.129305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 300/579] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:14:58.275629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8959b-0155-4fef-89e5-f594609a4ff2 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:58.275887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8959b-0155-4fef-89e5-f594609a4ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:58.276117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8959b-0155-4fef-89e5-f594609a4ff2 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:58.277607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 280/580] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:58.282896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7fa8-6477-4416-87d1-30340e4ab3c6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:58.283355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7fa8-6477-4416-87d1-30340e4ab3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:58.283441 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7fa8-6477-4416-87d1-30340e4ab3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:58.305257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-291a7fa8-6477-4416-87d1-30340e4ab3c6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:58.306426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-291a7fa8-6477-4416-87d1-30340e4ab3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:58.314088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:58.342046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8959b-0155-4fef-89e5-f594609a4ff2 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:58.418073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 301/581] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:14:58.420163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a7fa8-6477-4416-87d1-30340e4ab3c6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:58.527176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8959b-0155-4fef-89e5-f594609a4ff2 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:58.593256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a7fa8-6477-4416-87d1-30340e4ab3c6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:58.599038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedaaf9-b1ce-44cc-a18f-baabc5ae7eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:58.604369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedaaf9-b1ce-44cc-a18f-baabc5ae7eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:58.604890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedaaf9-b1ce-44cc-a18f-baabc5ae7eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:58.605383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedaaf9-b1ce-44cc-a18f-baabc5ae7eb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:58.624250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedaaf9-b1ce-44cc-a18f-baabc5ae7eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-4aedaaf9-b1ce-44cc-a18f-baabc5ae7eb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:58.629879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:58.630857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:14:58.631819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:58.635388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 281/582] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:14:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:58.640683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedaaf9-b1ce-44cc-a18f-baabc5ae7eb5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:58.666359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507e400-d73d-40cd-83be-6e5e5d5773b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:58.667002 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507e400-d73d-40cd-83be-6e5e5d5773b4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:58.667277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507e400-d73d-40cd-83be-6e5e5d5773b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:58.667544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507e400-d73d-40cd-83be-6e5e5d5773b4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:58.668127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507e400-d73d-40cd-83be-6e5e5d5773b4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:58.669531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507e400-d73d-40cd-83be-6e5e5d5773b4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-e507e400-d73d-40cd-83be-6e5e5d5773b4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:58.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:58.687892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:58.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 302/583] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:14:58 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:58.689665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882437b-d47f-405a-8c69-4f9935f65ec3 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:58.689665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882437b-d47f-405a-8c69-4f9935f65ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:58.690099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882437b-d47f-405a-8c69-4f9935f65ec3 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:58.695163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 303/584] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:14:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:14:58.696869 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e357a-efde-4d31-a001-4dd7063d4cd9 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:58.697179 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e357a-efde-4d31-a001-4dd7063d4cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:58.697452 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e357a-efde-4d31-a001-4dd7063d4cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:58.705307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:58.718090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c97e357a-efde-4d31-a001-4dd7063d4cd9 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:14:58.719276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c97e357a-efde-4d31-a001-4dd7063d4cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:14:58.720116 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:58.767718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedaaf9-b1ce-44cc-a18f-baabc5ae7eb5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:58.797378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 304/585] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:14:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:14:58.798032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e357a-efde-4d31-a001-4dd7063d4cd9 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:58.821961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c8d93-c5bf-4e38-84ac-e8eab16e66e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:58.822602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c8d93-c5bf-4e38-84ac-e8eab16e66e3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:58.822838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c8d93-c5bf-4e38-84ac-e8eab16e66e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:58.823101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c8d93-c5bf-4e38-84ac-e8eab16e66e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:58.823762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c8d93-c5bf-4e38-84ac-e8eab16e66e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:58.824056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c8d93-c5bf-4e38-84ac-e8eab16e66e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:58.825481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c8d93-c5bf-4e38-84ac-e8eab16e66e3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:58.838248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 282/586] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:14:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:14:58.838248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c8d93-c5bf-4e38-84ac-e8eab16e66e3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:58.938835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e357a-efde-4d31-a001-4dd7063d4cd9 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:58.949390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c8d93-c5bf-4e38-84ac-e8eab16e66e3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:58.966359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:58.983257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42415580-dcc1-4470-a7c3-4b400f16f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:58.984326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415580-dcc1-4470-a7c3-4b400f16f360 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:58.984975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415580-dcc1-4470-a7c3-4b400f16f360 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:58.985565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42415580-dcc1-4470-a7c3-4b400f16f360 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:58.986063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7438b57-90b0-4440-8391-69f8ac7437ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:58.986683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7438b57-90b0-4440-8391-69f8ac7437ce None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:58.986956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7438b57-90b0-4440-8391-69f8ac7437ce None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:58.987279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7438b57-90b0-4440-8391-69f8ac7437ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:58.987668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42415580-dcc1-4470-a7c3-4b400f16f360 None admin] RBAC: Adding query filter params (name=network) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:58.987845 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7438b57-90b0-4440-8391-69f8ac7437ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:58.988328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42415580-dcc1-4470-a7c3-4b400f16f360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:58.989226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7438b57-90b0-4440-8391-69f8ac7437ce None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:58.990356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42415580-dcc1-4470-a7c3-4b400f16f360 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:58.991971 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:58.997108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 305/587] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:14:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:58.998199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42415580-dcc1-4470-a7c3-4b400f16f360 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b7438b57-90b0-4440-8391-69f8ac7437ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:58.999479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:59.000437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:14:59.001298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:14:59.005913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 283/588] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 2 07:14:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:59.006231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7438b57-90b0-4440-8391-69f8ac7437ce None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.122260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7438b57-90b0-4440-8391-69f8ac7437ce None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.128913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42415580-dcc1-4470-a7c3-4b400f16f360 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.157063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa31656-4c8c-4b3d-bbb5-36b122aa7c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:59.157672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa31656-4c8c-4b3d-bbb5-36b122aa7c9e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:59.157946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa31656-4c8c-4b3d-bbb5-36b122aa7c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:59.158210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa31656-4c8c-4b3d-bbb5-36b122aa7c9e None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:59.158829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa31656-4c8c-4b3d-bbb5-36b122aa7c9e None admin] RBAC: Adding query filter params (type=network) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:59.159121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa31656-4c8c-4b3d-bbb5-36b122aa7c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:59.160468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa31656-4c8c-4b3d-bbb5-36b122aa7c9e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:59.165975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 284/589] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:59.166757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa31656-4c8c-4b3d-bbb5-36b122aa7c9e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.171645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf62e0-a851-4dc0-8123-5d35d7b519c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:59.172273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf62e0-a851-4dc0-8123-5d35d7b519c2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:59.172543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf62e0-a851-4dc0-8123-5d35d7b519c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:59.172806 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf62e0-a851-4dc0-8123-5d35d7b519c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:59.184936 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf62e0-a851-4dc0-8123-5d35d7b519c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:59.186390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf62e0-a851-4dc0-8123-5d35d7b519c2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-97bf62e0-a851-4dc0-8123-5d35d7b519c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:14:59.201423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:59.202559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:14:59.203468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:14:59.203468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:14:59.203468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:59.203468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 306/590] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:59.203468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf62e0-a851-4dc0-8123-5d35d7b519c2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.228950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:59.257450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:59.288425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa31656-4c8c-4b3d-bbb5-36b122aa7c9e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.316306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf62e0-a851-4dc0-8123-5d35d7b519c2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.325982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84a104-8843-4d64-b409-10964637c532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:59.326589 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84a104-8843-4d64-b409-10964637c532 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:59.326869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84a104-8843-4d64-b409-10964637c532 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:59.327142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84a104-8843-4d64-b409-10964637c532 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:59.327766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84a104-8843-4d64-b409-10964637c532 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:59.328082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84a104-8843-4d64-b409-10964637c532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:59.329470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84a104-8843-4d64-b409-10964637c532 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:59.334015 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 285/591] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:59.335019 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84a104-8843-4d64-b409-10964637c532 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.357370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938beb6-6301-4542-a115-6c8f94b382e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:59.358090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938beb6-6301-4542-a115-6c8f94b382e6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:59.358462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938beb6-6301-4542-a115-6c8f94b382e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:59.358739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938beb6-6301-4542-a115-6c8f94b382e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:59.370411 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938beb6-6301-4542-a115-6c8f94b382e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-5938beb6-6301-4542-a115-6c8f94b382e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:14:59.376513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:59.377530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 307/592] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:59.378384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938beb6-6301-4542-a115-6c8f94b382e6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.451922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84a104-8843-4d64-b409-10964637c532 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.462615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:59.487078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809d644-5149-4be9-bbe7-0a7426408bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:59.487693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809d644-5149-4be9-bbe7-0a7426408bde None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:59.487972 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809d644-5149-4be9-bbe7-0a7426408bde None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:59.488244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809d644-5149-4be9-bbe7-0a7426408bde None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:59.488941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809d644-5149-4be9-bbe7-0a7426408bde None admin] RBAC: Adding query filter params (interface=public, service_id=3ce4f827bc994314b5938447f17e00d9, region_id=RegionOne) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:59.489276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809d644-5149-4be9-bbe7-0a7426408bde None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:59.490696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809d644-5149-4be9-bbe7-0a7426408bde None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:59.495640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938beb6-6301-4542-a115-6c8f94b382e6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.503767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 286/593] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/endpoints?service_id=3ce4f827bc994314b5938447f17e00d9&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:59.504436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809d644-5149-4be9-bbe7-0a7426408bde None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.506261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:59.531922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548ec40-b71e-45b0-9387-f08ced8aa7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:59.532522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548ec40-b71e-45b0-9387-f08ced8aa7db None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:59.532799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548ec40-b71e-45b0-9387-f08ced8aa7db None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:59.533100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548ec40-b71e-45b0-9387-f08ced8aa7db None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:59.533737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548ec40-b71e-45b0-9387-f08ced8aa7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:59.534043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548ec40-b71e-45b0-9387-f08ced8aa7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:59.535415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548ec40-b71e-45b0-9387-f08ced8aa7db None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:59.547952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 308/594] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:59.548767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548ec40-b71e-45b0-9387-f08ced8aa7db None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.620207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809d644-5149-4be9-bbe7-0a7426408bde None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.655924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548ec40-b71e-45b0-9387-f08ced8aa7db None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.656795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16ea72-5205-42a7-99a1-4236612b7721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:59.657504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16ea72-5205-42a7-99a1-4236612b7721 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:59.657782 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16ea72-5205-42a7-99a1-4236612b7721 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:59.658078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16ea72-5205-42a7-99a1-4236612b7721 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:59.658711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16ea72-5205-42a7-99a1-4236612b7721 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:59.659011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16ea72-5205-42a7-99a1-4236612b7721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:59.660367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16ea72-5205-42a7-99a1-4236612b7721 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:59.670916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 287/595] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:59.670916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16ea72-5205-42a7-99a1-4236612b7721 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.698059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9383e-877f-4135-8f7c-62dfc5eaec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:59.698902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9383e-877f-4135-8f7c-62dfc5eaec25 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:59.699344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9383e-877f-4135-8f7c-62dfc5eaec25 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:59.699765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9383e-877f-4135-8f7c-62dfc5eaec25 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:59.700565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9383e-877f-4135-8f7c-62dfc5eaec25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:14:59.701042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9383e-877f-4135-8f7c-62dfc5eaec25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:59.702564 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9383e-877f-4135-8f7c-62dfc5eaec25 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:59.711546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 309/596] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:59.712508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9383e-877f-4135-8f7c-62dfc5eaec25 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.718463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:59.746465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:14:59.786704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16ea72-5205-42a7-99a1-4236612b7721 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.823175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7827914-4608-4832-90a8-a9be80bd6c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:59.823386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9383e-877f-4135-8f7c-62dfc5eaec25 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.823785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7827914-4608-4832-90a8-a9be80bd6c7b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:59.824066 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7827914-4608-4832-90a8-a9be80bd6c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:59.824335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7827914-4608-4832-90a8-a9be80bd6c7b None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:59.824937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7827914-4608-4832-90a8-a9be80bd6c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:59.826376 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7827914-4608-4832-90a8-a9be80bd6c7b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:59.831574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 288/597] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:14:59.832355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7827914-4608-4832-90a8-a9be80bd6c7b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.873228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d664658-2117-4de3-b175-dd7c0acda1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:14:59.874311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d664658-2117-4de3-b175-dd7c0acda1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:14:59.874786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d664658-2117-4de3-b175-dd7c0acda1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:14:59.875292 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d664658-2117-4de3-b175-dd7c0acda1c0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:14:59.884920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d664658-2117-4de3-b175-dd7c0acda1c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:14:59.886817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d664658-2117-4de3-b175-dd7c0acda1c0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-3d664658-2117-4de3-b175-dd7c0acda1c0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:14:59.901330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:14:59.902356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:14:59.903306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:14:59.903306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:14:59.903306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:14:59.903306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:14:59.903306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:14:59.903306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:14:59.903306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:14:59.903306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:14:59.903306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:14:59.903306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:14:59.905708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 310/598] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:14:59.906841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d664658-2117-4de3-b175-dd7c0acda1c0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:14:59.980307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7827914-4608-4832-90a8-a9be80bd6c7b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:14:59.982474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:00.025268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f46d6c-3dfe-48d3-9596-f3f0a4da4286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:00.025934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f46d6c-3dfe-48d3-9596-f3f0a4da4286 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.026181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f46d6c-3dfe-48d3-9596-f3f0a4da4286 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.026401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f46d6c-3dfe-48d3-9596-f3f0a4da4286 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.027218 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f46d6c-3dfe-48d3-9596-f3f0a4da4286 None admin] RBAC: Adding query filter params (interface=public, service_id=68d4537e4ba242009e34f41a64c2d382, region_id=RegionOne) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:00.027529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f46d6c-3dfe-48d3-9596-f3f0a4da4286 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:00.028907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f46d6c-3dfe-48d3-9596-f3f0a4da4286 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:00.031348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:00.036662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 289/599] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/endpoints?service_id=68d4537e4ba242009e34f41a64c2d382&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:00.037955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f46d6c-3dfe-48d3-9596-f3f0a4da4286 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:00.049695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d664658-2117-4de3-b175-dd7c0acda1c0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:00.092698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7362-9f10-4329-8ab6-0011ea45a4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:00.093537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7362-9f10-4329-8ab6-0011ea45a4eb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.093913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7362-9f10-4329-8ab6-0011ea45a4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.094361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7362-9f10-4329-8ab6-0011ea45a4eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.107016 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b7362-9f10-4329-8ab6-0011ea45a4eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:00.108721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b7362-9f10-4329-8ab6-0011ea45a4eb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-8d6b7362-9f10-4329-8ab6-0011ea45a4eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:00.124311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:00.125557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:00.126666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:00.126666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:00.126666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:00.127944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 311/600] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:00.128836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7362-9f10-4329-8ab6-0011ea45a4eb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:00.175748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f46d6c-3dfe-48d3-9596-f3f0a4da4286 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:00.222432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcde05-94cf-4d4b-9ee1-aec21a47448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:00.223327 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcde05-94cf-4d4b-9ee1-aec21a47448b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.223766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcde05-94cf-4d4b-9ee1-aec21a47448b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.224329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcde05-94cf-4d4b-9ee1-aec21a47448b None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.225530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcde05-94cf-4d4b-9ee1-aec21a47448b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:00.226005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcde05-94cf-4d4b-9ee1-aec21a47448b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:00.228495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcde05-94cf-4d4b-9ee1-aec21a47448b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:00.248760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7362-9f10-4329-8ab6-0011ea45a4eb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:00.261195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 290/601] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Nov 2 07:15:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:00.262082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcde05-94cf-4d4b-9ee1-aec21a47448b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:00.298483 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82007e6c-d300-4e39-b0eb-7380aab5fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:00.298985 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:00.299354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007e6c-d300-4e39-b0eb-7380aab5fefe None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.300093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007e6c-d300-4e39-b0eb-7380aab5fefe None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.300510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007e6c-d300-4e39-b0eb-7380aab5fefe None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.301273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82007e6c-d300-4e39-b0eb-7380aab5fefe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:00.302803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82007e6c-d300-4e39-b0eb-7380aab5fefe None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:00.309683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 312/602] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 07:15:00 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:00.310652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82007e6c-d300-4e39-b0eb-7380aab5fefe None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:00.323279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:00.404754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcde05-94cf-4d4b-9ee1-aec21a47448b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:00.445233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b128853-5b06-4617-9af0-8a85b92f3b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:00.446400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128853-5b06-4617-9af0-8a85b92f3b32 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.446824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128853-5b06-4617-9af0-8a85b92f3b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.447238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128853-5b06-4617-9af0-8a85b92f3b32 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.448033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b128853-5b06-4617-9af0-8a85b92f3b32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:00.448491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b128853-5b06-4617-9af0-8a85b92f3b32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:00.450049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b128853-5b06-4617-9af0-8a85b92f3b32 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:00.457305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82007e6c-d300-4e39-b0eb-7380aab5fefe None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:00.463668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 291/603] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:00.470371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652e35f-0e06-47a7-9a58-589e32f77465 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.470974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652e35f-0e06-47a7-9a58-589e32f77465 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.471413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652e35f-0e06-47a7-9a58-589e32f77465 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.472994 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 292/604] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:00.473919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652e35f-0e06-47a7-9a58-589e32f77465 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:00.503485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0af945-e746-4f78-8866-1e3b3a0078f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:00.504208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0af945-e746-4f78-8866-1e3b3a0078f0 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.504397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0af945-e746-4f78-8866-1e3b3a0078f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.504666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0af945-e746-4f78-8866-1e3b3a0078f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.577715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:00.583357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0af945-e746-4f78-8866-1e3b3a0078f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:00.585117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0af945-e746-4f78-8866-1e3b3a0078f0 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:00.597875 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:00.603519 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652e35f-0e06-47a7-9a58-589e32f77465 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:00.652617 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca8459-a77c-4181-be6d-d48fb81e6a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:00.653443 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8459-a77c-4181-be6d-d48fb81e6a86 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.653717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8459-a77c-4181-be6d-d48fb81e6a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.653981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8459-a77c-4181-be6d-d48fb81e6a86 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.666478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca8459-a77c-4181-be6d-d48fb81e6a86 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:00.667609 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca8459-a77c-4181-be6d-d48fb81e6a86 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-91ca8459-a77c-4181-be6d-d48fb81e6a86 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:15:00.681179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:00.682216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:00.683183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 293/605] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:15:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:00.683786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658f590-82a4-4fb2-8b3f-e4df4948fa6d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.684383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658f590-82a4-4fb2-8b3f-e4df4948fa6d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.684383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658f590-82a4-4fb2-8b3f-e4df4948fa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.708621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e658f590-82a4-4fb2-8b3f-e4df4948fa6d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:00.709759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e658f590-82a4-4fb2-8b3f-e4df4948fa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:00.711009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 313/606] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:15:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:15:00.712182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0af945-e746-4f78-8866-1e3b3a0078f0 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:00.793460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 294/607] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:00.794549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658f590-82a4-4fb2-8b3f-e4df4948fa6d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:00.862744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0af945-e746-4f78-8866-1e3b3a0078f0 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:00.883444 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:00.913394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:00.940011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658f590-82a4-4fb2-8b3f-e4df4948fa6d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:00.957615 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014c498-084d-4b30-a129-bec9ec929f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:00.958425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014c498-084d-4b30-a129-bec9ec929f97 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.958933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014c498-084d-4b30-a129-bec9ec929f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.959366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014c498-084d-4b30-a129-bec9ec929f97 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.960088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014c498-084d-4b30-a129-bec9ec929f97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:00.960389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014c498-084d-4b30-a129-bec9ec929f97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:00.962834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014c498-084d-4b30-a129-bec9ec929f97 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:00.979419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93487b-bb35-462e-99df-52f6d3b59b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:00.980519 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93487b-bb35-462e-99df-52f6d3b59b25 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:00.981030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93487b-bb35-462e-99df-52f6d3b59b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:00.981494 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93487b-bb35-462e-99df-52f6d3b59b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:00.995227 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93487b-bb35-462e-99df-52f6d3b59b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:00.997048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93487b-bb35-462e-99df-52f6d3b59b25 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:01.009058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 314/608] 10.222.0.13 () {56 vars in 1135 bytes} [Wed Nov 2 07:15:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:01.014772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014c498-084d-4b30-a129-bec9ec929f97 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5e93487b-bb35-462e-99df-52f6d3b59b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:01.022377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:01.023883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:01.024768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:01.024768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:01.024768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:01.026676 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 295/609] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:01.034054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93487b-bb35-462e-99df-52f6d3b59b25 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:01.151152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93487b-bb35-462e-99df-52f6d3b59b25 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:01.178255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:01.184241 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014c498-084d-4b30-a129-bec9ec929f97 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:01.189821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f29cc-1124-4336-8983-0970d1ae7133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:01.190433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f29cc-1124-4336-8983-0970d1ae7133 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:01.190704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f29cc-1124-4336-8983-0970d1ae7133 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:01.190969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f29cc-1124-4336-8983-0970d1ae7133 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:01.191621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f29cc-1124-4336-8983-0970d1ae7133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:01.191920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f29cc-1124-4336-8983-0970d1ae7133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:01.193306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f29cc-1124-4336-8983-0970d1ae7133 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:01.211499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 296/610] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:01.212618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f29cc-1124-4336-8983-0970d1ae7133 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:01.224263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd974c06-9104-438b-b5de-3621cdb3b0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:01.225334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd974c06-9104-438b-b5de-3621cdb3b0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:01.225813 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd974c06-9104-438b-b5de-3621cdb3b0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:01.226822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd974c06-9104-438b-b5de-3621cdb3b0f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:01.266171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:01.305485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd974c06-9104-438b-b5de-3621cdb3b0f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:01.307307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd974c06-9104-438b-b5de-3621cdb3b0f8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:01.317317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f29cc-1124-4336-8983-0970d1ae7133 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:01.353081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e03ea-b57c-4988-8f18-df1b52e2dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:01.353713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e03ea-b57c-4988-8f18-df1b52e2dc60 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:01.353987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e03ea-b57c-4988-8f18-df1b52e2dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:01.354252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e03ea-b57c-4988-8f18-df1b52e2dc60 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:01.354839 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e03ea-b57c-4988-8f18-df1b52e2dc60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:01.356200 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e03ea-b57c-4988-8f18-df1b52e2dc60 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-da1e03ea-b57c-4988-8f18-df1b52e2dc60 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:01.365518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:01.366481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:01.367711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 297/611] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 2 07:15:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:01.368616 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e03ea-b57c-4988-8f18-df1b52e2dc60 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:01.422685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:01.428797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 315/612] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:15:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 07:15:01.430303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd974c06-9104-438b-b5de-3621cdb3b0f8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:01.481193 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e03ea-b57c-4988-8f18-df1b52e2dc60 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:01.501027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:01.516038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3672e-ee80-42f1-8be4-08cdf99c6fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:01.516663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3672e-ee80-42f1-8be4-08cdf99c6fef None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:01.516936 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3672e-ee80-42f1-8be4-08cdf99c6fef None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:01.517235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3672e-ee80-42f1-8be4-08cdf99c6fef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:01.524837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3672e-ee80-42f1-8be4-08cdf99c6fef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:01.526321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3672e-ee80-42f1-8be4-08cdf99c6fef None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b5d3672e-ee80-42f1-8be4-08cdf99c6fef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:15:01.537720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:01.538781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:01.539704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:15:01.539704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:15:01.539704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:15:01.539704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:15:01.539704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:15:01.539704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:15:01.539704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:01.539704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:01.539704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 298/613] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:01.540243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3672e-ee80-42f1-8be4-08cdf99c6fef None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:01.544090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd974c06-9104-438b-b5de-3621cdb3b0f8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:01.582354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb85a7-12a5-4720-97e8-f00d0f8079b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:01.583332 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb85a7-12a5-4720-97e8-f00d0f8079b5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:01.583816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb85a7-12a5-4720-97e8-f00d0f8079b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:01.584303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb85a7-12a5-4720-97e8-f00d0f8079b5 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:01.585143 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb85a7-12a5-4720-97e8-f00d0f8079b5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:01.586219 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb85a7-12a5-4720-97e8-f00d0f8079b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:01.587871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb85a7-12a5-4720-97e8-f00d0f8079b5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:01.598154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 316/614] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:01.599287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb85a7-12a5-4720-97e8-f00d0f8079b5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:01.650670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3672e-ee80-42f1-8be4-08cdf99c6fef None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:01.660784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:01.686603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25238d-cd7c-4874-9106-da441b933673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:01.687242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25238d-cd7c-4874-9106-da441b933673 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:01.687519 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25238d-cd7c-4874-9106-da441b933673 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:01.687789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25238d-cd7c-4874-9106-da441b933673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:01.699267 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25238d-cd7c-4874-9106-da441b933673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:01.700658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25238d-cd7c-4874-9106-da441b933673 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:01.712480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb85a7-12a5-4720-97e8-f00d0f8079b5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1e25238d-cd7c-4874-9106-da441b933673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:01.717775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:01.718712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:01.719599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:01.719599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:01.719599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:01.719599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 299/615] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:01.719829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25238d-cd7c-4874-9106-da441b933673 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:01.752913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d4f99-583a-4322-b9a9-32b9d54e2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:01.757196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:01.757938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4f99-583a-4322-b9a9-32b9d54e2210 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:01.758483 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4f99-583a-4322-b9a9-32b9d54e2210 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:01.758949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4f99-583a-4322-b9a9-32b9d54e2210 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:01.759904 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d4f99-583a-4322-b9a9-32b9d54e2210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:01.760380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d4f99-583a-4322-b9a9-32b9d54e2210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:01.764519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d4f99-583a-4322-b9a9-32b9d54e2210 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:01.782050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 317/616] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:15:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:01.783152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d4f99-583a-4322-b9a9-32b9d54e2210 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:01.840770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25238d-cd7c-4874-9106-da441b933673 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:01.878649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9621496-9ec3-428c-95f6-59086ee8f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:01.879375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9621496-9ec3-428c-95f6-59086ee8f4de None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:01.879769 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9621496-9ec3-428c-95f6-59086ee8f4de None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:01.880107 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9621496-9ec3-428c-95f6-59086ee8f4de None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:01.880850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9621496-9ec3-428c-95f6-59086ee8f4de None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:01.881356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9621496-9ec3-428c-95f6-59086ee8f4de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:01.883621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9621496-9ec3-428c-95f6-59086ee8f4de None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:01.890489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 300/617] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:01.891483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9621496-9ec3-428c-95f6-59086ee8f4de None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:01.911317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d4f99-583a-4322-b9a9-32b9d54e2210 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:01.930309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:01.969806 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1bc97-95b9-4197-9368-d2b50365d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:01.970444 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1bc97-95b9-4197-9368-d2b50365d736 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:01.970722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1bc97-95b9-4197-9368-d2b50365d736 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:01.970997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1bc97-95b9-4197-9368-d2b50365d736 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:01.971669 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1bc97-95b9-4197-9368-d2b50365d736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:01.971976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1bc97-95b9-4197-9368-d2b50365d736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:01.973424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1bc97-95b9-4197-9368-d2b50365d736 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:02.002710 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 318/618] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:02.007362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1bc97-95b9-4197-9368-d2b50365d736 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:02.074304 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9621496-9ec3-428c-95f6-59086ee8f4de None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:02.104476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:02.150148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b63bd-9470-4000-a025-254901655160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:02.151145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b63bd-9470-4000-a025-254901655160 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:02.151423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b63bd-9470-4000-a025-254901655160 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:02.151687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b63bd-9470-4000-a025-254901655160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:02.152409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b63bd-9470-4000-a025-254901655160 None admin] RBAC: Adding query filter params (role.id=f6ee9e8014884bc5aff06380618f6aa2, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=e27f655402804b439fb23a3a983a1c5a) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:02.152709 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b63bd-9470-4000-a025-254901655160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:02.154851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b63bd-9470-4000-a025-254901655160 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:02.164483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 301/619] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:15:01 2022] GET /identity/v3/role_assignments?user.id=e27f655402804b439fb23a3a983a1c5a&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=f6ee9e8014884bc5aff06380618f6aa2 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:02.177574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1bc97-95b9-4197-9368-d2b50365d736 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:02.233508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046df7f-dcfc-4aca-bc93-142b186c9c11 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:02.234621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046df7f-dcfc-4aca-bc93-142b186c9c11 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:02.235358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046df7f-dcfc-4aca-bc93-142b186c9c11 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:02.239223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e499dbd-f0e3-46ed-a0e0-8c75e86ba5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:02.239623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 302/620] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:15:02.240884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e499dbd-f0e3-46ed-a0e0-8c75e86ba5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:02.240884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e499dbd-f0e3-46ed-a0e0-8c75e86ba5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:02.240884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e499dbd-f0e3-46ed-a0e0-8c75e86ba5f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:02.246289 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c54d4-17b3-4874-9ac1-1744f10a950c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:02.246829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c54d4-17b3-4874-9ac1-1744f10a950c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:02.247328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c54d4-17b3-4874-9ac1-1744f10a950c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:02.249552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e499dbd-f0e3-46ed-a0e0-8c75e86ba5f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:02.253059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e499dbd-f0e3-46ed-a0e0-8c75e86ba5f8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-2e499dbd-f0e3-46ed-a0e0-8c75e86ba5f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:15:02.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:02.270231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:02.271335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:15:02.271335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:15:02.271335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:15:02.271335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:15:02.271335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:15:02.271335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:15:02.271335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:02.271335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:02.284952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 319/621] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:02.290961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-235c54d4-17b3-4874-9ac1-1744f10a950c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:02.292427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-235c54d4-17b3-4874-9ac1-1744f10a950c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:02.306926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e499dbd-f0e3-46ed-a0e0-8c75e86ba5f8 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:02.425992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 303/622] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:02.466324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e499dbd-f0e3-46ed-a0e0-8c75e86ba5f8 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:02.479460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:02.505366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8f713-06a7-4dbc-88c2-680134b9f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:02.506244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8f713-06a7-4dbc-88c2-680134b9f04b None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:02.506669 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8f713-06a7-4dbc-88c2-680134b9f04b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:02.507097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8f713-06a7-4dbc-88c2-680134b9f04b None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:02.508499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8f713-06a7-4dbc-88c2-680134b9f04b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:02.508955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8f713-06a7-4dbc-88c2-680134b9f04b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:02.510623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8f713-06a7-4dbc-88c2-680134b9f04b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:02.529110 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 320/623] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:02.530914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c54d4-17b3-4874-9ac1-1744f10a950c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:02.556811 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:02.671054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c54d4-17b3-4874-9ac1-1744f10a950c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:02.722605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e29d2d-9bd3-42ac-8de3-d4edc1babd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:02.723123 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8f713-06a7-4dbc-88c2-680134b9f04b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:02.723834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29d2d-9bd3-42ac-8de3-d4edc1babd0b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:02.724345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29d2d-9bd3-42ac-8de3-d4edc1babd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:02.724814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29d2d-9bd3-42ac-8de3-d4edc1babd0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:02.726711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e29d2d-9bd3-42ac-8de3-d4edc1babd0b None admin] RBAC: Adding query filter params (role.id=6a01757540e64fed9041997458bd64e5, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=d80d3e8c42ab4942b32618db3f19dd88) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:02.727406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e29d2d-9bd3-42ac-8de3-d4edc1babd0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:02.729073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e29d2d-9bd3-42ac-8de3-d4edc1babd0b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:02.744767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 304/624] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:15:02 2022] GET /identity/v3/role_assignments?user.id=d80d3e8c42ab4942b32618db3f19dd88&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=6a01757540e64fed9041997458bd64e5 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:02.821674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b06b45-f506-4581-a459-7766d6327099 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:02.822013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b06b45-f506-4581-a459-7766d6327099 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:02.822222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b06b45-f506-4581-a459-7766d6327099 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:02.823581 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 305/625] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:02.829657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af40e-c8a1-4d02-ae20-cb5fb8aec57c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:02.829970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af40e-c8a1-4d02-ae20-cb5fb8aec57c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:02.830265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1af40e-c8a1-4d02-ae20-cb5fb8aec57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:02.859826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3e1af40e-c8a1-4d02-ae20-cb5fb8aec57c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:02.861073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3e1af40e-c8a1-4d02-ae20-cb5fb8aec57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:02.911285 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8f713-06a7-4dbc-88c2-680134b9f04b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:02.963922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfcae0-64a1-4370-a79f-0d68a1fc1ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:02.964558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfcae0-64a1-4370-a79f-0d68a1fc1ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:02.964838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfcae0-64a1-4370-a79f-0d68a1fc1ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:02.965138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfcae0-64a1-4370-a79f-0d68a1fc1ea3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:02.965723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfcae0-64a1-4370-a79f-0d68a1fc1ea3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:02.967227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecfcae0-64a1-4370-a79f-0d68a1fc1ea3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-6ecfcae0-64a1-4370-a79f-0d68a1fc1ea3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:02.977557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:02.978601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:02.979753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 321/626] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:02 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:02.982736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 306/627] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:02.992465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfcae0-64a1-4370-a79f-0d68a1fc1ea3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:03.042019 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:03.122787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfcae0-64a1-4370-a79f-0d68a1fc1ea3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:03.169318 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c592f-b1a2-44a3-8e09-0521630a24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:03.169921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c592f-b1a2-44a3-8e09-0521630a24be None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:03.170193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c592f-b1a2-44a3-8e09-0521630a24be None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:03.170459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c592f-b1a2-44a3-8e09-0521630a24be None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:03.171088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c592f-b1a2-44a3-8e09-0521630a24be None admin] RBAC: Adding query filter params (name=network) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:03.171383 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c592f-b1a2-44a3-8e09-0521630a24be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:03.172725 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c592f-b1a2-44a3-8e09-0521630a24be None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:03.181810 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 322/628] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:15:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:03.187594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1af40e-c8a1-4d02-ae20-cb5fb8aec57c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:03.217409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:03.305455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c592f-b1a2-44a3-8e09-0521630a24be None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:03.331368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1af40e-c8a1-4d02-ae20-cb5fb8aec57c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:03.370296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edde38-6ac3-4f2b-9633-49d9a4de93b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:03.371183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edde38-6ac3-4f2b-9633-49d9a4de93b3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:03.371607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edde38-6ac3-4f2b-9633-49d9a4de93b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:03.372021 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edde38-6ac3-4f2b-9633-49d9a4de93b3 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:03.372860 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edde38-6ac3-4f2b-9633-49d9a4de93b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:03.373473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edde38-6ac3-4f2b-9633-49d9a4de93b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:03.375072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edde38-6ac3-4f2b-9633-49d9a4de93b3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:03.385758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 307/629] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:15:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:03.388909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edde38-6ac3-4f2b-9633-49d9a4de93b3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:03.504018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:03.522253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c592f-b1a2-44a3-8e09-0521630a24be None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:03.533352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:03.543008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edde38-6ac3-4f2b-9633-49d9a4de93b3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:03.591556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48428154-7b26-4175-8c62-ce2973d5e9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:03.592182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48428154-7b26-4175-8c62-ce2973d5e9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:03.592455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48428154-7b26-4175-8c62-ce2973d5e9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:03.592976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48428154-7b26-4175-8c62-ce2973d5e9c6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:03.594090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48428154-7b26-4175-8c62-ce2973d5e9c6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:03.595449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48428154-7b26-4175-8c62-ce2973d5e9c6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:03.597379 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f148d8-63f4-4f74-8150-f386f987360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:03.597983 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f148d8-63f4-4f74-8150-f386f987360b None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:03.598255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f148d8-63f4-4f74-8150-f386f987360b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:03.598520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f148d8-63f4-4f74-8150-f386f987360b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:03.599176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f148d8-63f4-4f74-8150-f386f987360b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:03.600514 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f148d8-63f4-4f74-8150-f386f987360b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-48428154-7b26-4175-8c62-ce2973d5e9c6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:03.613999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:03.615272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:15:03.616334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:03.619759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 323/630] 10.222.0.13 () {56 vars in 1129 bytes} [Wed Nov 2 07:15:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:03.624639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48428154-7b26-4175-8c62-ce2973d5e9c6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:03.646152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 308/631] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:15:03 2022] POST /identity/v3/endpoints => generated 337 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:15:03.784051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48428154-7b26-4175-8c62-ce2973d5e9c6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:03.843273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fdd54-5b0a-46bc-9902-39736eaa7937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:03.843890 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fdd54-5b0a-46bc-9902-39736eaa7937 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:03.844216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fdd54-5b0a-46bc-9902-39736eaa7937 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:03.844494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fdd54-5b0a-46bc-9902-39736eaa7937 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:03.845161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fdd54-5b0a-46bc-9902-39736eaa7937 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:03.845462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fdd54-5b0a-46bc-9902-39736eaa7937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:03.846827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fdd54-5b0a-46bc-9902-39736eaa7937 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:03.853663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 324/632] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 07:15:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:03.859237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f148d8-63f4-4f74-8150-f386f987360b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:04.000879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f148d8-63f4-4f74-8150-f386f987360b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:04.039979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4c195-9d94-48f9-9f89-e3a812c741f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:04.040604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c195-9d94-48f9-9f89-e3a812c741f6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:04.040881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c195-9d94-48f9-9f89-e3a812c741f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:04.041199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c195-9d94-48f9-9f89-e3a812c741f6 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:04.041855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4c195-9d94-48f9-9f89-e3a812c741f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:04.042141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4c195-9d94-48f9-9f89-e3a812c741f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:04.043528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4c195-9d94-48f9-9f89-e3a812c741f6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:04.047049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:04.051515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 309/633] 10.222.0.13 () {56 vars in 1124 bytes} [Wed Nov 2 07:15:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:04.058080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fdd54-5b0a-46bc-9902-39736eaa7937 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:04.090253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:04.171180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fdd54-5b0a-46bc-9902-39736eaa7937 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:04.211148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be035-eae9-44ce-b4f1-d1b966f76fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:04.211757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be035-eae9-44ce-b4f1-d1b966f76fb2 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:04.212041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be035-eae9-44ce-b4f1-d1b966f76fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:04.212315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be035-eae9-44ce-b4f1-d1b966f76fb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:04.212979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be035-eae9-44ce-b4f1-d1b966f76fb2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:04.214374 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be035-eae9-44ce-b4f1-d1b966f76fb2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:04.238466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 325/634] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:15:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:04.564773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1fde6-a33a-4098-a8de-6a27d292009b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:04.565345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1fde6-a33a-4098-a8de-6a27d292009b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:04.565345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1fde6-a33a-4098-a8de-6a27d292009b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:04.566964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 310/635] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:04.572510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df51a-d8df-4159-b927-daae54fb62e6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:04.572944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df51a-d8df-4159-b927-daae54fb62e6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:04.573083 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df51a-d8df-4159-b927-daae54fb62e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:04.614694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-909df51a-d8df-4159-b927-daae54fb62e6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:04.615898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-909df51a-d8df-4159-b927-daae54fb62e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:04.692843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 326/636] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:04.823479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fbdc0-9fc1-4301-98ab-013be3b7fd0b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:04.823676 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fbdc0-9fc1-4301-98ab-013be3b7fd0b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:04.823930 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fbdc0-9fc1-4301-98ab-013be3b7fd0b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:04.825539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 311/637] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:04.830602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc4ea0-a7c2-41e9-9f41-3ce3f8f16620 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:04.830883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc4ea0-a7c2-41e9-9f41-3ce3f8f16620 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:04.831150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc4ea0-a7c2-41e9-9f41-3ce3f8f16620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:04.839282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:04.851923 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-25fc4ea0-a7c2-41e9-9f41-3ce3f8f16620 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:04.853786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-25fc4ea0-a7c2-41e9-9f41-3ce3f8f16620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:04.927307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 327/638] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:04.964022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fbdc0-9fc1-4301-98ab-013be3b7fd0b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:05.078864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fbdc0-9fc1-4301-98ab-013be3b7fd0b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:05.114850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9a198-800f-4acf-accd-0b3968b1184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:05.115876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9a198-800f-4acf-accd-0b3968b1184a None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:05.116354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9a198-800f-4acf-accd-0b3968b1184a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:05.116886 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9a198-800f-4acf-accd-0b3968b1184a None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:05.117754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9a198-800f-4acf-accd-0b3968b1184a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:05.119319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9a198-800f-4acf-accd-0b3968b1184a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:05.138332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 312/639] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:15:04 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:05.196682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc4ea0-a7c2-41e9-9f41-3ce3f8f16620 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:05.314295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc4ea0-a7c2-41e9-9f41-3ce3f8f16620 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:05.356501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:05.362913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159063d-fcf3-4921-a412-76a930cfc166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:05.363542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159063d-fcf3-4921-a412-76a930cfc166 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:05.363817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159063d-fcf3-4921-a412-76a930cfc166 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:05.364087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159063d-fcf3-4921-a412-76a930cfc166 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:05.376309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159063d-fcf3-4921-a412-76a930cfc166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9159063d-fcf3-4921-a412-76a930cfc166 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:15:05.381218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:05.382140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:05.383067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 328/640] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 07:15:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:05.388605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9a198-800f-4acf-accd-0b3968b1184a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:05.434637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033863d-ebee-449e-b935-83885a39ae37 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:05.434950 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033863d-ebee-449e-b935-83885a39ae37 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:05.435172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033863d-ebee-449e-b935-83885a39ae37 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:05.436740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 329/641] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:15:05.441907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4213-51bd-4e88-b37a-fb81e4180a39 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:05.442438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4213-51bd-4e88-b37a-fb81e4180a39 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:05.442929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4213-51bd-4e88-b37a-fb81e4180a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:05.456816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:05.464614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-478b4213-51bd-4e88-b37a-fb81e4180a39 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:05.466816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-478b4213-51bd-4e88-b37a-fb81e4180a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:05.501849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9a198-800f-4acf-accd-0b3968b1184a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:05.537944 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c7f35-3920-4874-affc-82efaa577462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:05.538550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c7f35-3920-4874-affc-82efaa577462 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:05.538994 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c7f35-3920-4874-affc-82efaa577462 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:05.539266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c7f35-3920-4874-affc-82efaa577462 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:05.539929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c7f35-3920-4874-affc-82efaa577462 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:05.540223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c7f35-3920-4874-affc-82efaa577462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:05.541729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c7f35-3920-4874-affc-82efaa577462 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:05.543391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 330/642] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:05 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:05.551423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 313/643] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Nov 2 07:15:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:05.557503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4213-51bd-4e88-b37a-fb81e4180a39 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:05.658543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4213-51bd-4e88-b37a-fb81e4180a39 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:05.694192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8436005-ec02-4616-9af7-c5b00df31d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:05.694817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436005-ec02-4616-9af7-c5b00df31d2e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:05.696015 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436005-ec02-4616-9af7-c5b00df31d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:05.696286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436005-ec02-4616-9af7-c5b00df31d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:05.703119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:05.706774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8436005-ec02-4616-9af7-c5b00df31d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:05.708222 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8436005-ec02-4616-9af7-c5b00df31d2e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-f8436005-ec02-4616-9af7-c5b00df31d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:05.723555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:05.724545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:05.725512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:05.725512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:05.725512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:05.725512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 331/644] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:05.731144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c7f35-3920-4874-affc-82efaa577462 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:05.829259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8436005-ec02-4616-9af7-c5b00df31d2e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:05.832627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c7f35-3920-4874-affc-82efaa577462 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:05.860314 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:05.880824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4ab22-0f9a-4eaf-aa9b-f27134975c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:05.882186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ab22-0f9a-4eaf-aa9b-f27134975c84 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:05.883550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ab22-0f9a-4eaf-aa9b-f27134975c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:05.884052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4ab22-0f9a-4eaf-aa9b-f27134975c84 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:05.885201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ab22-0f9a-4eaf-aa9b-f27134975c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:05.886163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ab22-0f9a-4eaf-aa9b-f27134975c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:05.888286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4ab22-0f9a-4eaf-aa9b-f27134975c84 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:05.906094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 314/645] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:05.917118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4ab22-0f9a-4eaf-aa9b-f27134975c84 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:05.960804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8436005-ec02-4616-9af7-c5b00df31d2e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:06.003589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be026b-aab2-4ace-a8ff-41eef3caf950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:06.004487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be026b-aab2-4ace-a8ff-41eef3caf950 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:06.004913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be026b-aab2-4ace-a8ff-41eef3caf950 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:06.005381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be026b-aab2-4ace-a8ff-41eef3caf950 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:06.006116 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be026b-aab2-4ace-a8ff-41eef3caf950 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:06.008230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be026b-aab2-4ace-a8ff-41eef3caf950 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-e8be026b-aab2-4ace-a8ff-41eef3caf950 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:06.019183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:06.020357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:06.021230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:06.029704 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 332/646] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:06.031252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be026b-aab2-4ace-a8ff-41eef3caf950 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:06.038572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4ab22-0f9a-4eaf-aa9b-f27134975c84 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:06.076049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:06.083596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4b5b4-1443-45af-b0d2-528a681f07a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:06.084231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b5b4-1443-45af-b0d2-528a681f07a9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:06.084501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b5b4-1443-45af-b0d2-528a681f07a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:06.084766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b5b4-1443-45af-b0d2-528a681f07a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:06.096077 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4b5b4-1443-45af-b0d2-528a681f07a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:06.097970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4b5b4-1443-45af-b0d2-528a681f07a9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e0a4b5b4-1443-45af-b0d2-528a681f07a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:15:06.111263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:06.112230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:06.113187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:06.113187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:06.113187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:15:06.113187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:15:06.113187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:15:06.113187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:15:06.113187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:15:06.113187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:15:06.113187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:15:06.113187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:06.115281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 315/647] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 07:15:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:06.122544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4b5b4-1443-45af-b0d2-528a681f07a9 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:06.159109 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be026b-aab2-4ace-a8ff-41eef3caf950 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:06.182740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:06.202355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a20f7-1768-46e4-b784-19018bb27a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:06.202975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a20f7-1768-46e4-b784-19018bb27a09 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:06.203256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a20f7-1768-46e4-b784-19018bb27a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:06.203531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a20f7-1768-46e4-b784-19018bb27a09 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:06.204218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a20f7-1768-46e4-b784-19018bb27a09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:06.204522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a20f7-1768-46e4-b784-19018bb27a09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:06.206193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a20f7-1768-46e4-b784-19018bb27a09 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:06.213068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 333/648] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:15:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:06.218591 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a20f7-1768-46e4-b784-19018bb27a09 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:06.263732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4b5b4-1443-45af-b0d2-528a681f07a9 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:06.299478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ffa47-6f5c-4a69-829d-462281a47753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:06.300188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ffa47-6f5c-4a69-829d-462281a47753 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:06.300563 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ffa47-6f5c-4a69-829d-462281a47753 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:06.300935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ffa47-6f5c-4a69-829d-462281a47753 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:06.301787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ffa47-6f5c-4a69-829d-462281a47753 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:06.302195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ffa47-6f5c-4a69-829d-462281a47753 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:06.303806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ffa47-6f5c-4a69-829d-462281a47753 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:06.323081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 316/649] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Nov 2 07:15:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:06.331690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ffa47-6f5c-4a69-829d-462281a47753 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:06.341603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:06.345635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a20f7-1768-46e4-b784-19018bb27a09 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:06.389380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885da135-55f6-4d3c-91bf-c106c0218d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:06.390096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885da135-55f6-4d3c-91bf-c106c0218d35 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:06.390440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885da135-55f6-4d3c-91bf-c106c0218d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:06.390772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885da135-55f6-4d3c-91bf-c106c0218d35 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:06.391730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885da135-55f6-4d3c-91bf-c106c0218d35 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:06.392567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885da135-55f6-4d3c-91bf-c106c0218d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:06.394319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885da135-55f6-4d3c-91bf-c106c0218d35 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:06.401173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 334/650] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:15:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:06.453065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:06.458243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ffa47-6f5c-4a69-829d-462281a47753 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:06.501901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc822d4d-fa51-4dcb-8190-9e600edcba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:06.502815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc822d4d-fa51-4dcb-8190-9e600edcba72 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:06.503265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc822d4d-fa51-4dcb-8190-9e600edcba72 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:06.503699 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc822d4d-fa51-4dcb-8190-9e600edcba72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:06.516396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc822d4d-fa51-4dcb-8190-9e600edcba72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:06.518174 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc822d4d-fa51-4dcb-8190-9e600edcba72 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-fc822d4d-fa51-4dcb-8190-9e600edcba72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:06.535187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:06.536408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:06.537546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:06.537546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:06.537546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:06.539567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 317/651] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:06.545511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885da135-55f6-4d3c-91bf-c106c0218d35 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:06.589847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365055-54d8-4b90-8ff8-a067f731c82c None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:06.590115 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365055-54d8-4b90-8ff8-a067f731c82c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:06.590390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365055-54d8-4b90-8ff8-a067f731c82c None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:06.591711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 318/652] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:06.598189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb125d2-3428-41a5-bc4e-25ea7043931c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:06.598465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb125d2-3428-41a5-bc4e-25ea7043931c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:06.598732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb125d2-3428-41a5-bc4e-25ea7043931c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:06.623369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4fb125d2-3428-41a5-bc4e-25ea7043931c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:06.624822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4fb125d2-3428-41a5-bc4e-25ea7043931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:06.664421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885da135-55f6-4d3c-91bf-c106c0218d35 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:06.701901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b5c33-71cc-42fe-a660-7c20e9f0d1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:06.702503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b5c33-71cc-42fe-a660-7c20e9f0d1bc None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:06.702776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b5c33-71cc-42fe-a660-7c20e9f0d1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:06.703117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b5c33-71cc-42fe-a660-7c20e9f0d1bc None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:06.704313 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b5c33-71cc-42fe-a660-7c20e9f0d1bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:06.704620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b5c33-71cc-42fe-a660-7c20e9f0d1bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:06.706305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b5c33-71cc-42fe-a660-7c20e9f0d1bc None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:06.709646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 319/653] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:06 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:06.722544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 335/654] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:06.730347 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb125d2-3428-41a5-bc4e-25ea7043931c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:06.815188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:06.836611 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb125d2-3428-41a5-bc4e-25ea7043931c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:06.872186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fdc39-b2d1-4232-9356-866657d57655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:06.872859 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fdc39-b2d1-4232-9356-866657d57655 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:06.873165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fdc39-b2d1-4232-9356-866657d57655 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:06.873432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fdc39-b2d1-4232-9356-866657d57655 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:06.880245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fdc39-b2d1-4232-9356-866657d57655 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:06.881710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fdc39-b2d1-4232-9356-866657d57655 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5e9fdc39-b2d1-4232-9356-866657d57655 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:15:06.893046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:06.893926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:06.894838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:15:06.894838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:15:06.894838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:15:06.894838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:15:06.894838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:15:06.894838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:15:06.894838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:06.894838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:06.894838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 320/655] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:06.907501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b5c33-71cc-42fe-a660-7c20e9f0d1bc None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:06.941482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:06.995684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fdc39-b2d1-4232-9356-866657d57655 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:07.024337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b5c33-71cc-42fe-a660-7c20e9f0d1bc None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:07.062924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e6ae-5820-4a8d-9068-c602d30a43b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:07.063529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e6ae-5820-4a8d-9068-c602d30a43b6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:07.063855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e6ae-5820-4a8d-9068-c602d30a43b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:07.064129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e6ae-5820-4a8d-9068-c602d30a43b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:07.064816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281e6ae-5820-4a8d-9068-c602d30a43b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:07.065143 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281e6ae-5820-4a8d-9068-c602d30a43b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:07.066577 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281e6ae-5820-4a8d-9068-c602d30a43b6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:07.081941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 336/656] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:15:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:07.091810 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e6ae-5820-4a8d-9068-c602d30a43b6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:07.102452 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fdc39-b2d1-4232-9356-866657d57655 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:07.137001 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d9d5-1a8a-4bc1-927c-0d3572e892d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:07.137632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d9d5-1a8a-4bc1-927c-0d3572e892d2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:07.137905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d9d5-1a8a-4bc1-927c-0d3572e892d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:07.138172 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2d9d5-1a8a-4bc1-927c-0d3572e892d2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:07.138756 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2d9d5-1a8a-4bc1-927c-0d3572e892d2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:07.140108 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2d9d5-1a8a-4bc1-927c-0d3572e892d2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-69d2d9d5-1a8a-4bc1-927c-0d3572e892d2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:07.149330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:07.150598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:15:07.151626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:07.155345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 321/657] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:15:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:07.156777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d9d5-1a8a-4bc1-927c-0d3572e892d2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:07.160964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:07.194018 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:07.215222 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e6ae-5820-4a8d-9068-c602d30a43b6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:07.268502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2d9d5-1a8a-4bc1-927c-0d3572e892d2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:07.270395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd4114-8af6-48b7-8e6e-4a2324d9be8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:07.271723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd4114-8af6-48b7-8e6e-4a2324d9be8a None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:07.272208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd4114-8af6-48b7-8e6e-4a2324d9be8a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:07.272674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd4114-8af6-48b7-8e6e-4a2324d9be8a None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/e27f655402804b439fb23a3a983a1c5a/roles/23eea1dba0c84318a532485385fd19b2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:07.283719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd4114-8af6-48b7-8e6e-4a2324d9be8a None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=e27f655402804b439fb23a3a983a1c5a, role_id=23eea1dba0c84318a532485385fd19b2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:07.286097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd4114-8af6-48b7-8e6e-4a2324d9be8a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:07.313196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 337/658] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:15:07 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/e27f655402804b439fb23a3a983a1c5a/roles/23eea1dba0c84318a532485385fd19b2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:15:07.357842 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c6666-0494-4242-8426-153f76f267c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:07.358889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c6666-0494-4242-8426-153f76f267c9 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:07.359392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c6666-0494-4242-8426-153f76f267c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:07.359910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c6666-0494-4242-8426-153f76f267c9 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:07.360826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c6666-0494-4242-8426-153f76f267c9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:07.361373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c6666-0494-4242-8426-153f76f267c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:07.362935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c6666-0494-4242-8426-153f76f267c9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:07.375414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 322/659] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:15:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:07.381549 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd4114-8af6-48b7-8e6e-4a2324d9be8a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:07.521836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd4114-8af6-48b7-8e6e-4a2324d9be8a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:07.565983 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c034c8-0714-4100-8293-865c551bdd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:07.567237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c034c8-0714-4100-8293-865c551bdd9e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:07.568151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c034c8-0714-4100-8293-865c551bdd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:07.568818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c034c8-0714-4100-8293-865c551bdd9e None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:07.570127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c034c8-0714-4100-8293-865c551bdd9e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:07.571464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c034c8-0714-4100-8293-865c551bdd9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:07.574600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c034c8-0714-4100-8293-865c551bdd9e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:07.583016 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 338/660] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:15:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:07.606723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740bdf3-eaa7-4236-a0dc-e5d3f5656b2f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:07.606723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740bdf3-eaa7-4236-a0dc-e5d3f5656b2f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:07.606723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740bdf3-eaa7-4236-a0dc-e5d3f5656b2f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:07.607456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 323/661] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:07.613326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbcc9c-2827-4615-9983-8bef007f02a1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:07.613631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbcc9c-2827-4615-9983-8bef007f02a1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:07.613899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbcc9c-2827-4615-9983-8bef007f02a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:07.643849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c0dbcc9c-2827-4615-9983-8bef007f02a1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:07.645089 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c0dbcc9c-2827-4615-9983-8bef007f02a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:07.647316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:07.726740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 339/662] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:07 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:08.014308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740bdf3-eaa7-4236-a0dc-e5d3f5656b2f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:08.086157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:08.121939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740bdf3-eaa7-4236-a0dc-e5d3f5656b2f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:08.157525 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf83a5e-144b-40be-adb1-a2b44a2ca6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:08.158152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83a5e-144b-40be-adb1-a2b44a2ca6ca None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:08.158425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83a5e-144b-40be-adb1-a2b44a2ca6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:08.158693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83a5e-144b-40be-adb1-a2b44a2ca6ca None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:08.159268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf83a5e-144b-40be-adb1-a2b44a2ca6ca None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:08.160617 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf83a5e-144b-40be-adb1-a2b44a2ca6ca None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1cf83a5e-144b-40be-adb1-a2b44a2ca6ca None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:08.170380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:08.171292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:15:08.172164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:08.175191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 324/663] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 2 07:15:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:08.178569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbcc9c-2827-4615-9983-8bef007f02a1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:08.283005 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbcc9c-2827-4615-9983-8bef007f02a1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:08.318673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528400fd-980c-4a8d-a778-e580552d9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:08.319324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528400fd-980c-4a8d-a778-e580552d9f17 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:08.319597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528400fd-980c-4a8d-a778-e580552d9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:08.319860 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528400fd-980c-4a8d-a778-e580552d9f17 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:08.321062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528400fd-980c-4a8d-a778-e580552d9f17 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:08.321419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528400fd-980c-4a8d-a778-e580552d9f17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:08.322781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528400fd-980c-4a8d-a778-e580552d9f17 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:08.332409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 340/664] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:08.333768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf83a5e-144b-40be-adb1-a2b44a2ca6ca None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:08.439996 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf83a5e-144b-40be-adb1-a2b44a2ca6ca None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:08.474830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:08.480538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbd3e8-c737-4a58-a440-a64378ed7068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:08.481228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbd3e8-c737-4a58-a440-a64378ed7068 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:08.481939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbd3e8-c737-4a58-a440-a64378ed7068 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:08.482452 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbd3e8-c737-4a58-a440-a64378ed7068 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:08.483399 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbd3e8-c737-4a58-a440-a64378ed7068 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:08.484135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbd3e8-c737-4a58-a440-a64378ed7068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:08.485551 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbd3e8-c737-4a58-a440-a64378ed7068 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:08.491005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 325/665] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:08.497365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528400fd-980c-4a8d-a778-e580552d9f17 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:08.500489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:08.615212 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528400fd-980c-4a8d-a778-e580552d9f17 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:08.650751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3128e-f442-4bb1-b537-a2d1f86a125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:08.651350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3128e-f442-4bb1-b537-a2d1f86a125a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:08.651621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3128e-f442-4bb1-b537-a2d1f86a125a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:08.651978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3128e-f442-4bb1-b537-a2d1f86a125a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:08.652679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3128e-f442-4bb1-b537-a2d1f86a125a None admin] RBAC: Adding query filter params (interface=public, service_id=02eb42f0840d46a7961eb7481d574db6, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:08.652980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3128e-f442-4bb1-b537-a2d1f86a125a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:08.653682 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27c58b-64c5-443f-9afd-feb00a7d8a14 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:08.653968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27c58b-64c5-443f-9afd-feb00a7d8a14 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:08.654243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27c58b-64c5-443f-9afd-feb00a7d8a14 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:08.654342 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3128e-f442-4bb1-b537-a2d1f86a125a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:08.655685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 326/666] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:15:08.660684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3a64-d6f2-4605-8342-6c1f5c135833 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:08.660964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3a64-d6f2-4605-8342-6c1f5c135833 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:08.661277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d3a64-d6f2-4605-8342-6c1f5c135833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:08.664501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 341/667] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 07:15:08 2022] GET /identity/v3/endpoints?service_id=02eb42f0840d46a7961eb7481d574db6&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:08.670122 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3128e-f442-4bb1-b537-a2d1f86a125a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:08.686043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-565d3a64-d6f2-4605-8342-6c1f5c135833 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:08.687244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-565d3a64-d6f2-4605-8342-6c1f5c135833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:08.746406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:08.761120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 327/668] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:08 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:08.785817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3128e-f442-4bb1-b537-a2d1f86a125a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:08.822041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454db2-db0a-4d8b-8e9c-4b21a0ad4c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:08.822994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454db2-db0a-4d8b-8e9c-4b21a0ad4c67 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:08.823465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454db2-db0a-4d8b-8e9c-4b21a0ad4c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:08.823987 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454db2-db0a-4d8b-8e9c-4b21a0ad4c67 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:08.824786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54454db2-db0a-4d8b-8e9c-4b21a0ad4c67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:08.826379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54454db2-db0a-4d8b-8e9c-4b21a0ad4c67 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:08.837177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 342/669] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 07:15:08 2022] GET /identity/v3/services => generated 1029 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:15:09.041776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d3a64-d6f2-4605-8342-6c1f5c135833 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:09.145368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d3a64-d6f2-4605-8342-6c1f5c135833 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:09.172679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:09.182252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006609d-202e-44ac-8272-a792d61320f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:09.182851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006609d-202e-44ac-8272-a792d61320f4 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:09.183122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006609d-202e-44ac-8272-a792d61320f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:09.183384 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006609d-202e-44ac-8272-a792d61320f4 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:09.184039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006609d-202e-44ac-8272-a792d61320f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:09.185407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006609d-202e-44ac-8272-a792d61320f4 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:09.201042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 328/670] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:15:09 2022] POST /identity/v3/services => generated 241 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:09.904656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f404b6-5a56-422b-8363-69cbf6e4dc8d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:09.905204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f404b6-5a56-422b-8363-69cbf6e4dc8d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:09.905500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f404b6-5a56-422b-8363-69cbf6e4dc8d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:09.907271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 343/671] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:09.912919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdd47-192e-4761-be91-12c22d110471 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:09.913338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdd47-192e-4761-be91-12c22d110471 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:09.913819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdd47-192e-4761-be91-12c22d110471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:09.921610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c6c0-2057-4af6-bf85-c03a2dcfab38 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:09.921892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c6c0-2057-4af6-bf85-c03a2dcfab38 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:09.922169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885c6c0-2057-4af6-bf85-c03a2dcfab38 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:09.923733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 344/672] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:15:09.928970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a99cd-4f26-4eea-9851-19ebd05adcc6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:09.929807 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a99cd-4f26-4eea-9851-19ebd05adcc6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:09.930091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a99cd-4f26-4eea-9851-19ebd05adcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:09.934004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c01fdd47-192e-4761-be91-12c22d110471 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:09.935251 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c01fdd47-192e-4761-be91-12c22d110471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:09.948708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-360a99cd-4f26-4eea-9851-19ebd05adcc6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:09.949918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-360a99cd-4f26-4eea-9851-19ebd05adcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:10.033239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 345/674] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:09 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:10.036457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 329/674] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:09 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:10.296750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a99cd-4f26-4eea-9851-19ebd05adcc6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:10.303137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fdd47-192e-4761-be91-12c22d110471 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:10.361115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:10.418404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fdd47-192e-4761-be91-12c22d110471 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:10.422514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a99cd-4f26-4eea-9851-19ebd05adcc6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:10.437375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:10.457651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afb126-0447-43da-9372-d5f0723d4739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:10.458291 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afb126-0447-43da-9372-d5f0723d4739 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:10.458569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afb126-0447-43da-9372-d5f0723d4739 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:10.458842 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afb126-0447-43da-9372-d5f0723d4739 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:10.469252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f0e36-d68b-4504-9ec4-dc32b14db957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:10.469994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f0e36-d68b-4504-9ec4-dc32b14db957 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:10.470269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f0e36-d68b-4504-9ec4-dc32b14db957 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:10.470536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f0e36-d68b-4504-9ec4-dc32b14db957 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:10.470880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afb126-0447-43da-9372-d5f0723d4739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:15:10.471198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f0e36-d68b-4504-9ec4-dc32b14db957 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:10.472544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f0e36-d68b-4504-9ec4-dc32b14db957 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-e8afb126-0447-43da-9372-d5f0723d4739 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:15:10.477119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:10.478112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:15:10.478929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:10.481937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 330/675] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 07:15:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:10.490349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afb126-0447-43da-9372-d5f0723d4739 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:10.501253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 346/676] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:15:10 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:10.613257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afb126-0447-43da-9372-d5f0723d4739 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:10.657991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf92a3-1cd1-4a26-9bbc-559470c2eed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:10.659262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf92a3-1cd1-4a26-9bbc-559470c2eed3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:10.659262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf92a3-1cd1-4a26-9bbc-559470c2eed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:10.659262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf92a3-1cd1-4a26-9bbc-559470c2eed3 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:10.659855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf92a3-1cd1-4a26-9bbc-559470c2eed3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:10.660150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf92a3-1cd1-4a26-9bbc-559470c2eed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:10.661622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf92a3-1cd1-4a26-9bbc-559470c2eed3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:10.676628 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 331/677] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Nov 2 07:15:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:10.678890 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f0e36-d68b-4504-9ec4-dc32b14db957 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:10.790163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f0e36-d68b-4504-9ec4-dc32b14db957 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:10.808128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:10.828863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7b452-5786-463f-83ff-ee7914b5f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:10.829802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7b452-5786-463f-83ff-ee7914b5f32e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:10.831283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7b452-5786-463f-83ff-ee7914b5f32e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:10.831710 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7b452-5786-463f-83ff-ee7914b5f32e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:10.844191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7b452-5786-463f-83ff-ee7914b5f32e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:10.845847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7b452-5786-463f-83ff-ee7914b5f32e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-eda7b452-5786-463f-83ff-ee7914b5f32e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:10.860940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:10.862117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:10.863352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:10.863352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:10.863352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:10.869107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 347/678] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:10.870977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf92a3-1cd1-4a26-9bbc-559470c2eed3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:10.918113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:10.985325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf92a3-1cd1-4a26-9bbc-559470c2eed3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:11.020679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b3323-3d5a-47b9-a4c3-4c93fcbe3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:11.021557 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b3323-3d5a-47b9-a4c3-4c93fcbe3eba None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.022004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b3323-3d5a-47b9-a4c3-4c93fcbe3eba None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.022417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b3323-3d5a-47b9-a4c3-4c93fcbe3eba None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.023462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b3323-3d5a-47b9-a4c3-4c93fcbe3eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:11.024154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b3323-3d5a-47b9-a4c3-4c93fcbe3eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:11.025789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b3323-3d5a-47b9-a4c3-4c93fcbe3eba None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:11.043192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 332/679] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:11.045692 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7b452-5786-463f-83ff-ee7914b5f32e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:11.048365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f810f-5e0c-4f01-b67e-d9d23652873f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.048644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f810f-5e0c-4f01-b67e-d9d23652873f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.048910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f810f-5e0c-4f01-b67e-d9d23652873f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.050383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 333/680] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:15:11.055359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4e2d-deb8-4454-b60c-ef4bda12af52 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.055639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4e2d-deb8-4454-b60c-ef4bda12af52 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.055911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a4e2d-deb8-4454-b60c-ef4bda12af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.074387 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5c4a4e2d-deb8-4454-b60c-ef4bda12af52 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:11.075569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5c4a4e2d-deb8-4454-b60c-ef4bda12af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:11.146399 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 334/681] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:11.169309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7b452-5786-463f-83ff-ee7914b5f32e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:11.203953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8408-6c4d-46a4-8fec-79381cd906d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:11.204577 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8408-6c4d-46a4-8fec-79381cd906d1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.204854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8408-6c4d-46a4-8fec-79381cd906d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.205199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8408-6c4d-46a4-8fec-79381cd906d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.213032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8408-6c4d-46a4-8fec-79381cd906d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:11.214469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8408-6c4d-46a4-8fec-79381cd906d1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-7fcd8408-6c4d-46a4-8fec-79381cd906d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:15:11.226944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:11.228191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:11.229175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:11.229175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:11.229175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:15:11.229175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:15:11.229175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:15:11.229175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:15:11.229175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:15:11.229175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:15:11.229175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:15:11.229175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:11.232831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 348/682] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 07:15:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:11.234210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a4e2d-deb8-4454-b60c-ef4bda12af52 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:11.275234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:11.344670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a4e2d-deb8-4454-b60c-ef4bda12af52 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:11.379929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc1ec-d941-4c5d-8af9-e6f69afe4805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:11.380535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc1ec-d941-4c5d-8af9-e6f69afe4805 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.380808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc1ec-d941-4c5d-8af9-e6f69afe4805 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.381096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc1ec-d941-4c5d-8af9-e6f69afe4805 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.381821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc1ec-d941-4c5d-8af9-e6f69afe4805 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:11.382119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc1ec-d941-4c5d-8af9-e6f69afe4805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:11.383860 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc1ec-d941-4c5d-8af9-e6f69afe4805 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:11.407378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 335/683] 10.222.0.13 () {56 vars in 1149 bytes} [Wed Nov 2 07:15:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:11.408635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8408-6c4d-46a4-8fec-79381cd906d1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:11.410857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a56ef1-a810-4937-92d9-a317940e1c93 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.411239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a56ef1-a810-4937-92d9-a317940e1c93 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.411714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a56ef1-a810-4937-92d9-a317940e1c93 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.417852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 336/684] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:11.423128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a56ef1-a810-4937-92d9-a317940e1c93 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:11.443661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:11.504596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:11.523971 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8408-6c4d-46a4-8fec-79381cd906d1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:11.532249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a56ef1-a810-4937-92d9-a317940e1c93 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:11.562016 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae0b4e-2a88-4b3b-8019-8947c8d9acfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:11.562731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0b4e-2a88-4b3b-8019-8947c8d9acfe None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.563006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0b4e-2a88-4b3b-8019-8947c8d9acfe None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.563272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0b4e-2a88-4b3b-8019-8947c8d9acfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.569527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3441e4d-69fc-4c2a-864c-f2f555e78a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:11.570401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441e4d-69fc-4c2a-864c-f2f555e78a1e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.570848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441e4d-69fc-4c2a-864c-f2f555e78a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.571272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3441e4d-69fc-4c2a-864c-f2f555e78a1e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.572103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441e4d-69fc-4c2a-864c-f2f555e78a1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:11.573755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3441e4d-69fc-4c2a-864c-f2f555e78a1e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-c3441e4d-69fc-4c2a-864c-f2f555e78a1e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:11.583412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:11.584549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:15:11.586249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:11.593776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 337/685] 10.222.0.13 () {56 vars in 1132 bytes} [Wed Nov 2 07:15:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:11.594427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31940d-ff98-4e1b-9d32-56dee9f0516c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.594704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31940d-ff98-4e1b-9d32-56dee9f0516c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.594975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31940d-ff98-4e1b-9d32-56dee9f0516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.612501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1c31940d-ff98-4e1b-9d32-56dee9f0516c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:11.613713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1c31940d-ff98-4e1b-9d32-56dee9f0516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:11.637816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae0b4e-2a88-4b3b-8019-8947c8d9acfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:11.640091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae0b4e-2a88-4b3b-8019-8947c8d9acfe None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:11.672302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:11.685142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 338/686] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:11.685142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31940d-ff98-4e1b-9d32-56dee9f0516c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:11.772077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 349/687] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:15:11 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 07:15:11.777534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae0b4e-2a88-4b3b-8019-8947c8d9acfe None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:11.786153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:11.829569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31940d-ff98-4e1b-9d32-56dee9f0516c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:11.868005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf132b26-592e-4ed2-bdca-cbdcb5d03263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:11.869040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf132b26-592e-4ed2-bdca-cbdcb5d03263 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.869532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf132b26-592e-4ed2-bdca-cbdcb5d03263 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.870016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf132b26-592e-4ed2-bdca-cbdcb5d03263 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.870836 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf132b26-592e-4ed2-bdca-cbdcb5d03263 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:11.871329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf132b26-592e-4ed2-bdca-cbdcb5d03263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:11.872882 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf132b26-592e-4ed2-bdca-cbdcb5d03263 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:11.878594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 339/688] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:11.884375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf132b26-592e-4ed2-bdca-cbdcb5d03263 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:11.901659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae0b4e-2a88-4b3b-8019-8947c8d9acfe None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:11.935839 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:11.947207 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e4494-f5d4-4a8e-b616-fc343a854241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:11.947840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e4494-f5d4-4a8e-b616-fc343a854241 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:11.948118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e4494-f5d4-4a8e-b616-fc343a854241 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:11.948387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e4494-f5d4-4a8e-b616-fc343a854241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:11.959290 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e4494-f5d4-4a8e-b616-fc343a854241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:11.961051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e4494-f5d4-4a8e-b616-fc343a854241 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-3d9e4494-f5d4-4a8e-b616-fc343a854241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:11.976130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:11.977644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:11.978580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:11.978580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:11.978580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:11.978580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 350/689] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:11.979327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e4494-f5d4-4a8e-b616-fc343a854241 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:12.011255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf132b26-592e-4ed2-bdca-cbdcb5d03263 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.048212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8c9a0-2804-455d-87ab-c41e816e409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.048812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8c9a0-2804-455d-87ab-c41e816e409a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.049124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8c9a0-2804-455d-87ab-c41e816e409a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.049397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8c9a0-2804-455d-87ab-c41e816e409a None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.050017 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8c9a0-2804-455d-87ab-c41e816e409a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:12.050319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8c9a0-2804-455d-87ab-c41e816e409a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.051674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8c9a0-2804-455d-87ab-c41e816e409a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.054092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:12.058220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 340/690] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:12.059097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8c9a0-2804-455d-87ab-c41e816e409a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:12.088566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e4494-f5d4-4a8e-b616-fc343a854241 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.123496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95707d2e-5d00-465d-834f-64b1b38b780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.124421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707d2e-5d00-465d-834f-64b1b38b780f None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.124701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707d2e-5d00-465d-834f-64b1b38b780f None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.124969 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707d2e-5d00-465d-834f-64b1b38b780f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.125574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95707d2e-5d00-465d-834f-64b1b38b780f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.126931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95707d2e-5d00-465d-834f-64b1b38b780f None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-95707d2e-5d00-465d-834f-64b1b38b780f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:12.135693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:12.136928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:12.138096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:12.141764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 351/691] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:12.142587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95707d2e-5d00-465d-834f-64b1b38b780f None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:12.167550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8c9a0-2804-455d-87ab-c41e816e409a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.190298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:12.204479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1d6c-6048-453d-876b-2038613bbb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.205115 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1d6c-6048-453d-876b-2038613bbb6c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.205395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1d6c-6048-453d-876b-2038613bbb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.205664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1d6c-6048-453d-876b-2038613bbb6c None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.206301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b1d6c-6048-453d-876b-2038613bbb6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:12.206601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b1d6c-6048-453d-876b-2038613bbb6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.207955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b1d6c-6048-453d-876b-2038613bbb6c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.220233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 341/692] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:12.220881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1d6c-6048-453d-876b-2038613bbb6c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:12.255062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95707d2e-5d00-465d-834f-64b1b38b780f None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.283833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:12.293654 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c7ea1-a59c-4452-a850-37469a21b627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.294255 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c7ea1-a59c-4452-a850-37469a21b627 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.294529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c7ea1-a59c-4452-a850-37469a21b627 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.294797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c7ea1-a59c-4452-a850-37469a21b627 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.295466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c7ea1-a59c-4452-a850-37469a21b627 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.296829 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c7ea1-a59c-4452-a850-37469a21b627 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.317989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 352/693] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:15:12 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:12.318729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c7ea1-a59c-4452-a850-37469a21b627 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:12.350206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1d6c-6048-453d-876b-2038613bbb6c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.411820 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f568-eebf-4640-bc51-1d58f96bdc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.413300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f568-eebf-4640-bc51-1d58f96bdc1e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.413515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f568-eebf-4640-bc51-1d58f96bdc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.413828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f568-eebf-4640-bc51-1d58f96bdc1e None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.414502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f568-eebf-4640-bc51-1d58f96bdc1e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:12.414914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f568-eebf-4640-bc51-1d58f96bdc1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.416384 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f568-eebf-4640-bc51-1d58f96bdc1e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.427482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 342/694] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:15:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:12.428970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f568-eebf-4640-bc51-1d58f96bdc1e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:12.448404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:12.454126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c7ea1-a59c-4452-a850-37469a21b627 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.504632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53078a14-e077-4748-b6f7-f50ce427edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.505428 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078a14-e077-4748-b6f7-f50ce427edba None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.505703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078a14-e077-4748-b6f7-f50ce427edba None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.505973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078a14-e077-4748-b6f7-f50ce427edba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.514324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53078a14-e077-4748-b6f7-f50ce427edba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.515770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53078a14-e077-4748-b6f7-f50ce427edba None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-53078a14-e077-4748-b6f7-f50ce427edba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:15:12.531453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:12.532435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:12.533392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:15:12.533392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:15:12.533392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:15:12.533392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:15:12.533392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:15:12.533392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:15:12.533392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:12.533392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:12.534675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 353/695] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:12.541448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53078a14-e077-4748-b6f7-f50ce427edba None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:12.559214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f568-eebf-4640-bc51-1d58f96bdc1e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.583428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:12.603022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9993bb-5e8b-407a-bb75-9380859f9b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.603632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9993bb-5e8b-407a-bb75-9380859f9b6b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.603912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9993bb-5e8b-407a-bb75-9380859f9b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.604186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9993bb-5e8b-407a-bb75-9380859f9b6b None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.604916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9993bb-5e8b-407a-bb75-9380859f9b6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:12.605274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9993bb-5e8b-407a-bb75-9380859f9b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.606639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9993bb-5e8b-407a-bb75-9380859f9b6b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.617775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 343/696] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:15:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:12.619437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9993bb-5e8b-407a-bb75-9380859f9b6b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:12.677703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53078a14-e077-4748-b6f7-f50ce427edba None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.722901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5e6c-6942-4678-a487-b48d24a1b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.724824 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5e6c-6942-4678-a487-b48d24a1b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.727029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5e6c-6942-4678-a487-b48d24a1b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.727531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5e6c-6942-4678-a487-b48d24a1b6a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.728520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be5e6c-6942-4678-a487-b48d24a1b6a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:12.729061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be5e6c-6942-4678-a487-b48d24a1b6a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.730726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be5e6c-6942-4678-a487-b48d24a1b6a2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.746255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9993bb-5e8b-407a-bb75-9380859f9b6b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.747355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 354/697] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:12.753962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5e6c-6942-4678-a487-b48d24a1b6a2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:12.784302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:12.788179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182dd17-892e-41e6-8fa9-4c7eda395d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.788951 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182dd17-892e-41e6-8fa9-4c7eda395d0b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.789412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182dd17-892e-41e6-8fa9-4c7eda395d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.789781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182dd17-892e-41e6-8fa9-4c7eda395d0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.790586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182dd17-892e-41e6-8fa9-4c7eda395d0b None admin] RBAC: Adding query filter params (interface=public, service_id=34684bcd721345e484882e587b28bcef, region_id=RegionOne) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:12.790987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182dd17-892e-41e6-8fa9-4c7eda395d0b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.792364 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182dd17-892e-41e6-8fa9-4c7eda395d0b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.802341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 344/698] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 07:15:12 2022] GET /identity/v3/endpoints?service_id=34684bcd721345e484882e587b28bcef&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:12.802341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de2b0-abb2-44c1-bf2c-3240df8b1dee None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.802341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de2b0-abb2-44c1-bf2c-3240df8b1dee None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.802341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de2b0-abb2-44c1-bf2c-3240df8b1dee None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.802341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 345/699] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:12.803214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de2b0-abb2-44c1-bf2c-3240df8b1dee None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:12.863847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:12.875277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5e6c-6942-4678-a487-b48d24a1b6a2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.920640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1a66-73ff-4c27-8484-5c69c65d9fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.921275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1a66-73ff-4c27-8484-5c69c65d9fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.921541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1a66-73ff-4c27-8484-5c69c65d9fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.921808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1a66-73ff-4c27-8484-5c69c65d9fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.922524 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1a66-73ff-4c27-8484-5c69c65d9fb9 None admin] RBAC: Adding query filter params (role.id=23eea1dba0c84318a532485385fd19b2, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=e27f655402804b439fb23a3a983a1c5a) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:12.922825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1a66-73ff-4c27-8484-5c69c65d9fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.923787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de2b0-abb2-44c1-bf2c-3240df8b1dee None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:12.924230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1a66-73ff-4c27-8484-5c69c65d9fb9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.931803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 355/700] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:15:12 2022] GET /identity/v3/role_assignments?user.id=e27f655402804b439fb23a3a983a1c5a&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=23eea1dba0c84318a532485385fd19b2 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:12.941081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38fa15-ffea-4b41-8d6a-6b867d63421d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.941081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38fa15-ffea-4b41-8d6a-6b867d63421d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.941081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38fa15-ffea-4b41-8d6a-6b867d63421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.963970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d1bce-6d1e-4d36-944a-a99689c080af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:12.964612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1bce-6d1e-4d36-944a-a99689c080af None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:12.964880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1bce-6d1e-4d36-944a-a99689c080af None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:12.965187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1bce-6d1e-4d36-944a-a99689c080af None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:12.965805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d1bce-6d1e-4d36-944a-a99689c080af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:12.967230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d1bce-6d1e-4d36-944a-a99689c080af None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:12.971875 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ed38fa15-ffea-4b41-8d6a-6b867d63421d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:12.973632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ed38fa15-ffea-4b41-8d6a-6b867d63421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:12.981497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 346/701] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 07:15:12 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:15:13.058533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 356/702] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:13.333996 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d1bce-6d1e-4d36-944a-a99689c080af None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:13.442623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d1bce-6d1e-4d36-944a-a99689c080af None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:13.457591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:13.480789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8275a-52ee-423b-a0c1-da8af090e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:13.481779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8275a-52ee-423b-a0c1-da8af090e122 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:13.482254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8275a-52ee-423b-a0c1-da8af090e122 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:13.482721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8275a-52ee-423b-a0c1-da8af090e122 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:13.483516 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8275a-52ee-423b-a0c1-da8af090e122 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:13.485077 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8275a-52ee-423b-a0c1-da8af090e122 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-49d8275a-52ee-423b-a0c1-da8af090e122 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:13.495044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:13.496022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:15:13.496840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:13.499516 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 347/703] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:15:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:13.505562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38fa15-ffea-4b41-8d6a-6b867d63421d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:13.525427 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:13.608923 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38fa15-ffea-4b41-8d6a-6b867d63421d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:13.645563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34930766-7309-4571-9494-b1d8ca3883b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:13.646165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34930766-7309-4571-9494-b1d8ca3883b6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:13.646437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34930766-7309-4571-9494-b1d8ca3883b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:13.646703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34930766-7309-4571-9494-b1d8ca3883b6 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:13.647329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34930766-7309-4571-9494-b1d8ca3883b6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:13.647623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34930766-7309-4571-9494-b1d8ca3883b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:13.649665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34930766-7309-4571-9494-b1d8ca3883b6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:13.655093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 357/704] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:15:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:13.660666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8275a-52ee-423b-a0c1-da8af090e122 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:13.769186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8275a-52ee-423b-a0c1-da8af090e122 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:13.807209 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c276dc7-6cd2-4675-84f3-fe7ba670855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:13.808202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c276dc7-6cd2-4675-84f3-fe7ba670855d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:13.808689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c276dc7-6cd2-4675-84f3-fe7ba670855d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:13.809272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c276dc7-6cd2-4675-84f3-fe7ba670855d None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:13.810154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c276dc7-6cd2-4675-84f3-fe7ba670855d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:13.810658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c276dc7-6cd2-4675-84f3-fe7ba670855d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:13.812237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c276dc7-6cd2-4675-84f3-fe7ba670855d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:13.818058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 348/705] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:15:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:13.826243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34930766-7309-4571-9494-b1d8ca3883b6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:13.909844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:13.932506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34930766-7309-4571-9494-b1d8ca3883b6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:13.967059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c65fb-f2ca-4e3f-8c1a-b52fb5a8f8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:13.967648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c65fb-f2ca-4e3f-8c1a-b52fb5a8f8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:13.968185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c65fb-f2ca-4e3f-8c1a-b52fb5a8f8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:13.968452 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c65fb-f2ca-4e3f-8c1a-b52fb5a8f8e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:13.969163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c65fb-f2ca-4e3f-8c1a-b52fb5a8f8e8 None admin] RBAC: Adding query filter params (interface=public, service_id=28556891008a4882bc6a9fd7ad65c0c1, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:13.969467 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c65fb-f2ca-4e3f-8c1a-b52fb5a8f8e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:13.970803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c65fb-f2ca-4e3f-8c1a-b52fb5a8f8e8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:13.976058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 358/706] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 07:15:13 2022] GET /identity/v3/endpoints?service_id=28556891008a4882bc6a9fd7ad65c0c1&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:13.982292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c276dc7-6cd2-4675-84f3-fe7ba670855d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:14.023542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:14.082867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c276dc7-6cd2-4675-84f3-fe7ba670855d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:14.116390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d2e97-ee64-482d-8d69-5b1c5a56bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:14.117142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d2e97-ee64-482d-8d69-5b1c5a56bf0d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:14.117460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d2e97-ee64-482d-8d69-5b1c5a56bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:14.117765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d2e97-ee64-482d-8d69-5b1c5a56bf0d None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:14.118362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d2e97-ee64-482d-8d69-5b1c5a56bf0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:14.119713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d2e97-ee64-482d-8d69-5b1c5a56bf0d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:14.126282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 349/707] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 07:15:13 2022] GET /identity/v3/services => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:15:14.753874 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a8f31-cd07-483b-b8c7-e43f9a959822 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:14.754393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a8f31-cd07-483b-b8c7-e43f9a959822 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:14.754393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a8f31-cd07-483b-b8c7-e43f9a959822 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:14.756097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 359/708] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:14.762050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b8f0b-e46f-4013-9de7-61a87af9d736 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:14.762489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b8f0b-e46f-4013-9de7-61a87af9d736 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:14.762635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b8f0b-e46f-4013-9de7-61a87af9d736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:14.781669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d34b8f0b-e46f-4013-9de7-61a87af9d736 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:14.782861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d34b8f0b-e46f-4013-9de7-61a87af9d736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:14.854199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 350/709] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:15.123337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a8f31-cd07-483b-b8c7-e43f9a959822 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:15.196512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7dd1-4a9f-4834-9d10-8a6c1a62c4dc None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:15.196858 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7dd1-4a9f-4834-9d10-8a6c1a62c4dc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:15.197081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce7dd1-4a9f-4834-9d10-8a6c1a62c4dc None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:15.198657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 351/710] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:15.205419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201828b3-1b15-452e-a43a-53914718b777 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:15.205701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201828b3-1b15-452e-a43a-53914718b777 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:15.205971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201828b3-1b15-452e-a43a-53914718b777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:15.229861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-201828b3-1b15-452e-a43a-53914718b777 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:15.231323 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-201828b3-1b15-452e-a43a-53914718b777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:15.236528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a8f31-cd07-483b-b8c7-e43f9a959822 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:15.260078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:15.273763 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb99f0-8c55-4c55-abfb-d8547110e6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:15.274389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb99f0-8c55-4c55-abfb-d8547110e6eb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:15.275059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb99f0-8c55-4c55-abfb-d8547110e6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:15.275364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb99f0-8c55-4c55-abfb-d8547110e6eb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:15.275943 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb99f0-8c55-4c55-abfb-d8547110e6eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:15.277672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb99f0-8c55-4c55-abfb-d8547110e6eb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-12eb99f0-8c55-4c55-abfb-d8547110e6eb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:15.288701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:15.290331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:15.291180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 360/711] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:15.292599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049c560-2605-4b3d-adaf-f044ed3bac41 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:15.292599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049c560-2605-4b3d-adaf-f044ed3bac41 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:15.292764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049c560-2605-4b3d-adaf-f044ed3bac41 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:15.294663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 361/712] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:15.296607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049c560-2605-4b3d-adaf-f044ed3bac41 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:15.306993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 352/713] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:15.308453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39713528-d735-4bbc-9c20-6e9797112546 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:15.309333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39713528-d735-4bbc-9c20-6e9797112546 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:15.309739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39713528-d735-4bbc-9c20-6e9797112546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:15.313414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:15.332941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-39713528-d735-4bbc-9c20-6e9797112546 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:15.334408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-39713528-d735-4bbc-9c20-6e9797112546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:15.417891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049c560-2605-4b3d-adaf-f044ed3bac41 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:15.420029 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 353/714] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:15.459910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680e6e4-07a8-494e-9c4d-caab452fb0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:15.460514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680e6e4-07a8-494e-9c4d-caab452fb0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:15.461576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680e6e4-07a8-494e-9c4d-caab452fb0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:15.461850 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680e6e4-07a8-494e-9c4d-caab452fb0d6 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:15.462526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680e6e4-07a8-494e-9c4d-caab452fb0d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:15.462827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680e6e4-07a8-494e-9c4d-caab452fb0d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:15.464230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680e6e4-07a8-494e-9c4d-caab452fb0d6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:15.470294 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 362/715] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:15:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:15.475532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39713528-d735-4bbc-9c20-6e9797112546 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:15.576645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:15.584031 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39713528-d735-4bbc-9c20-6e9797112546 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:15.599720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680e6e4-07a8-494e-9c4d-caab452fb0d6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:15.627886 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fa04-c858-4adf-8113-4fdfde1de04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:15.628808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fa04-c858-4adf-8113-4fdfde1de04a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:15.629263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fa04-c858-4adf-8113-4fdfde1de04a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:15.629653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fa04-c858-4adf-8113-4fdfde1de04a None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:15.630284 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853fa04-c858-4adf-8113-4fdfde1de04a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:15.630578 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853fa04-c858-4adf-8113-4fdfde1de04a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:15.633244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853fa04-c858-4adf-8113-4fdfde1de04a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:15.639793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 354/716] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:15:15 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:15.685541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:15.715163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fa04-c858-4adf-8113-4fdfde1de04a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:15.718513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680e6e4-07a8-494e-9c4d-caab452fb0d6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:15.757735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c3d3b-bd1a-4342-94ff-0d98718663e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:15.758418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3d3b-bd1a-4342-94ff-0d98718663e2 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:15.758642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3d3b-bd1a-4342-94ff-0d98718663e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:15.758952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3d3b-bd1a-4342-94ff-0d98718663e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:15.759542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c3d3b-bd1a-4342-94ff-0d98718663e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:15.760995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c3d3b-bd1a-4342-94ff-0d98718663e2 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-5c8c3d3b-bd1a-4342-94ff-0d98718663e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:15.771178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:15.772271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:15.774625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 363/717] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:15.779093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c3d3b-bd1a-4342-94ff-0d98718663e2 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:15.840533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fa04-c858-4adf-8113-4fdfde1de04a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:15.888198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab6f4b-4bcb-478c-9b37-ddebe7d87bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:15.889747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab6f4b-4bcb-478c-9b37-ddebe7d87bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:15.890176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab6f4b-4bcb-478c-9b37-ddebe7d87bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:15.890615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab6f4b-4bcb-478c-9b37-ddebe7d87bb2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:15.891791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab6f4b-4bcb-478c-9b37-ddebe7d87bb2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:15.893644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab6f4b-4bcb-478c-9b37-ddebe7d87bb2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:15.894480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c3d3b-bd1a-4342-94ff-0d98718663e2 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1aab6f4b-4bcb-478c-9b37-ddebe7d87bb2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:15.906058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:15.907295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:15:15.908344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:15.911041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 355/718] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Nov 2 07:15:15 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:15.917435 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab6f4b-4bcb-478c-9b37-ddebe7d87bb2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:15.941379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6e397-4efd-4a0c-951b-d4d54580cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:15.941900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6e397-4efd-4a0c-951b-d4d54580cce1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:15.942456 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6e397-4efd-4a0c-951b-d4d54580cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:15.942739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6e397-4efd-4a0c-951b-d4d54580cce1 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:15.943369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6e397-4efd-4a0c-951b-d4d54580cce1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:15.943664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6e397-4efd-4a0c-951b-d4d54580cce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:15.945225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6e397-4efd-4a0c-951b-d4d54580cce1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:15.946339 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:15.952154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 364/719] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:15:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:15.953317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:15.957371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6e397-4efd-4a0c-951b-d4d54580cce1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:16.036908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab6f4b-4bcb-478c-9b37-ddebe7d87bb2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:16.074363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d115fe-2614-4c38-9867-b7f282b646db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:16.075405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d115fe-2614-4c38-9867-b7f282b646db None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:16.075869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d115fe-2614-4c38-9867-b7f282b646db None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:16.076329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d115fe-2614-4c38-9867-b7f282b646db None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:16.077326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d115fe-2614-4c38-9867-b7f282b646db None admin] RBAC: Adding query filter params (name=image) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:16.077632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d115fe-2614-4c38-9867-b7f282b646db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:16.078779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6e397-4efd-4a0c-951b-d4d54580cce1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:16.078998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d115fe-2614-4c38-9867-b7f282b646db None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:16.089877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 356/720] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:16.090896 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d115fe-2614-4c38-9867-b7f282b646db None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:16.123010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e397-dc6a-476a-a377-d82743898f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:16.124223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e397-dc6a-476a-a377-d82743898f0a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:16.124946 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e397-dc6a-476a-a377-d82743898f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:16.125865 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e397-dc6a-476a-a377-d82743898f0a None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:16.126953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e397-dc6a-476a-a377-d82743898f0a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:16.127451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e397-dc6a-476a-a377-d82743898f0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:16.130140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e397-dc6a-476a-a377-d82743898f0a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:16.136806 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 365/721] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:15:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:16.142960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e397-dc6a-476a-a377-d82743898f0a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:16.190540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:16.207530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d115fe-2614-4c38-9867-b7f282b646db None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:16.226989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:16.247249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3417a-8612-471a-bed7-908c02da9be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:16.247876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3417a-8612-471a-bed7-908c02da9be6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:16.248150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3417a-8612-471a-bed7-908c02da9be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:16.248419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3417a-8612-471a-bed7-908c02da9be6 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:16.249094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3417a-8612-471a-bed7-908c02da9be6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:16.249398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3417a-8612-471a-bed7-908c02da9be6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:16.250956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3417a-8612-471a-bed7-908c02da9be6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:16.264583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 357/722] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:16.280832 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e397-dc6a-476a-a377-d82743898f0a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:16.319697 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2350d-5e40-40c0-98da-593397879384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:16.321936 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2350d-5e40-40c0-98da-593397879384 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:16.322439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2350d-5e40-40c0-98da-593397879384 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:16.322968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2350d-5e40-40c0-98da-593397879384 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:16.323872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2350d-5e40-40c0-98da-593397879384 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:16.325514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2350d-5e40-40c0-98da-593397879384 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:16.350171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 366/723] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:15:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:15:16.376158 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eeae0-fe01-49bd-bd1f-3aef558e3f6b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:16.376493 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eeae0-fe01-49bd-bd1f-3aef558e3f6b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:16.376710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eeae0-fe01-49bd-bd1f-3aef558e3f6b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:16.378371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 358/724] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:16.387806 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d936d8e-f32c-4490-8b89-a393743d21b2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:16.388451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d936d8e-f32c-4490-8b89-a393743d21b2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:16.388926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d936d8e-f32c-4490-8b89-a393743d21b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:16.410161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9d936d8e-f32c-4490-8b89-a393743d21b2 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:16.411900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9d936d8e-f32c-4490-8b89-a393743d21b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:16.501240 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 367/725] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:16.771284 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eeae0-fe01-49bd-bd1f-3aef558e3f6b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:16.878861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eeae0-fe01-49bd-bd1f-3aef558e3f6b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:16.921048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69ecf7-83af-4260-ba2d-6396e19a90b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:16.921048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69ecf7-83af-4260-ba2d-6396e19a90b5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:16.921048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69ecf7-83af-4260-ba2d-6396e19a90b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:16.921048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69ecf7-83af-4260-ba2d-6396e19a90b5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:16.921398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69ecf7-83af-4260-ba2d-6396e19a90b5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:16.921398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69ecf7-83af-4260-ba2d-6396e19a90b5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-9c69ecf7-83af-4260-ba2d-6396e19a90b5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:16.927677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:16.928653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:16.929646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 359/726] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:15:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:16.934878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d936d8e-f32c-4490-8b89-a393743d21b2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:16.984609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:17.042489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d936d8e-f32c-4490-8b89-a393743d21b2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:17.078792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df2b5c-420e-47bf-b68f-0c01db11ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:17.079484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2b5c-420e-47bf-b68f-0c01db11ce36 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:17.079764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2b5c-420e-47bf-b68f-0c01db11ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:17.080033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2b5c-420e-47bf-b68f-0c01db11ce36 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:17.080666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df2b5c-420e-47bf-b68f-0c01db11ce36 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:17.080962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df2b5c-420e-47bf-b68f-0c01db11ce36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:17.082344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df2b5c-420e-47bf-b68f-0c01db11ce36 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:17.087763 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 368/727] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:15:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:17.093641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69ecf7-83af-4260-ba2d-6396e19a90b5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:17.110631 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:17.200470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69ecf7-83af-4260-ba2d-6396e19a90b5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:17.237964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69fe52-570b-4510-b8e1-587795d35bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:17.238579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69fe52-570b-4510-b8e1-587795d35bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:17.238852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69fe52-570b-4510-b8e1-587795d35bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:17.239117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69fe52-570b-4510-b8e1-587795d35bf0 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:17.239747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69fe52-570b-4510-b8e1-587795d35bf0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:17.240039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69fe52-570b-4510-b8e1-587795d35bf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:17.241434 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69fe52-570b-4510-b8e1-587795d35bf0 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:17.247608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 360/728] 10.222.0.13 () {56 vars in 1114 bytes} [Wed Nov 2 07:15:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:17.252887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df2b5c-420e-47bf-b68f-0c01db11ce36 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:17.360272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df2b5c-420e-47bf-b68f-0c01db11ce36 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:17.370877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:17.401299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc52e81-6365-420f-9696-95cb133b2dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:17.401899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc52e81-6365-420f-9696-95cb133b2dd8 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:17.402171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc52e81-6365-420f-9696-95cb133b2dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:17.402437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc52e81-6365-420f-9696-95cb133b2dd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:17.403105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc52e81-6365-420f-9696-95cb133b2dd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:17.404441 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc52e81-6365-420f-9696-95cb133b2dd8 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:17.425285 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 369/729] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:15:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:17.937157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb99f20-d080-42fd-9dda-ac8ea7ee248b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:17.937784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb99f20-d080-42fd-9dda-ac8ea7ee248b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:17.937784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb99f20-d080-42fd-9dda-ac8ea7ee248b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:17.939271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 361/730] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:17.944597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e1ec-9ab6-479e-9554-8f3e14a3ef63 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:17.945669 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e1ec-9ab6-479e-9554-8f3e14a3ef63 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:17.946014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e1ec-9ab6-479e-9554-8f3e14a3ef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:17.964747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5e56e1ec-9ab6-479e-9554-8f3e14a3ef63 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:17.965949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5e56e1ec-9ab6-479e-9554-8f3e14a3ef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:18.049140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 370/731] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:18.313054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb99f20-d080-42fd-9dda-ac8ea7ee248b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:18.399794 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:18.427643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb99f20-d080-42fd-9dda-ac8ea7ee248b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:18.470396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b7c6e-64e1-42c1-837f-adb48a83c137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:18.471016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b7c6e-64e1-42c1-837f-adb48a83c137 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:18.471286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b7c6e-64e1-42c1-837f-adb48a83c137 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:18.471555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b7c6e-64e1-42c1-837f-adb48a83c137 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:18.472298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b7c6e-64e1-42c1-837f-adb48a83c137 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:18.473731 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b7c6e-64e1-42c1-837f-adb48a83c137 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:18.497242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 362/732] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:15:18 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:18.544536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21d82-4d27-4d7a-90ac-6baaf21b9c70 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:18.544536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21d82-4d27-4d7a-90ac-6baaf21b9c70 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:18.544536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21d82-4d27-4d7a-90ac-6baaf21b9c70 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:18.545418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 371/733] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:18.551798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403adde-dcbf-4ac1-971f-d9a5e5b72bc0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:18.552138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403adde-dcbf-4ac1-971f-d9a5e5b72bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:18.552469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403adde-dcbf-4ac1-971f-d9a5e5b72bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:18.575038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefe170-5d63-45b3-b125-113e13e4d71b None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:18.575234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefe170-5d63-45b3-b125-113e13e4d71b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:18.575512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefe170-5d63-45b3-b125-113e13e4d71b None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:18.577111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 372/734] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:18.581520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d403adde-dcbf-4ac1-971f-d9a5e5b72bc0 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:18.582751 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d403adde-dcbf-4ac1-971f-d9a5e5b72bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:18.583265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75576-4328-47e6-843c-84dc7952b552 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:18.583813 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75576-4328-47e6-843c-84dc7952b552 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:18.584315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e75576-4328-47e6-843c-84dc7952b552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:18.607093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a2e75576-4328-47e6-843c-84dc7952b552 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:18.609431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a2e75576-4328-47e6-843c-84dc7952b552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:18.670283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 363/735] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:18.696804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 373/736] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:18.950307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403adde-dcbf-4ac1-971f-d9a5e5b72bc0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:18.972455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e75576-4328-47e6-843c-84dc7952b552 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:18.995489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:19.016993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:19.057984 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403adde-dcbf-4ac1-971f-d9a5e5b72bc0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:19.095171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e75576-4328-47e6-843c-84dc7952b552 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:19.099848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ece24-d971-44e9-ad3d-60e18eddbe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:19.100459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ece24-d971-44e9-ad3d-60e18eddbe8e None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:19.100731 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ece24-d971-44e9-ad3d-60e18eddbe8e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:19.100994 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ece24-d971-44e9-ad3d-60e18eddbe8e None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:19.102266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ece24-d971-44e9-ad3d-60e18eddbe8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:19.103872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ece24-d971-44e9-ad3d-60e18eddbe8e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:19.131322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 364/737] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:15:18 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:19.151131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baec459-9968-44d2-9a59-1dd27de1e12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:19.151763 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec459-9968-44d2-9a59-1dd27de1e12d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:19.152039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec459-9968-44d2-9a59-1dd27de1e12d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:19.152305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec459-9968-44d2-9a59-1dd27de1e12d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:19.152883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baec459-9968-44d2-9a59-1dd27de1e12d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:19.154420 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baec459-9968-44d2-9a59-1dd27de1e12d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-4baec459-9968-44d2-9a59-1dd27de1e12d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:19.165267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:19.166328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:19.167178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 374/738] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:19.174421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ece24-d971-44e9-ad3d-60e18eddbe8e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:19.308335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ece24-d971-44e9-ad3d-60e18eddbe8e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:19.335969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:19.351133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b96fd7-bf79-47d9-9be7-f813a3b2b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:19.352279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b96fd7-bf79-47d9-9be7-f813a3b2b798 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:19.352549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b96fd7-bf79-47d9-9be7-f813a3b2b798 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:19.352815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b96fd7-bf79-47d9-9be7-f813a3b2b798 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:19.353491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b96fd7-bf79-47d9-9be7-f813a3b2b798 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:19.353788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b96fd7-bf79-47d9-9be7-f813a3b2b798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:19.355145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b96fd7-bf79-47d9-9be7-f813a3b2b798 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:19.360463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 365/739] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:15:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:19.366023 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baec459-9968-44d2-9a59-1dd27de1e12d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:19.453952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:19.474407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baec459-9968-44d2-9a59-1dd27de1e12d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:19.510214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bf36e-2378-442d-abd9-cb8249214395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:19.510815 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf36e-2378-442d-abd9-cb8249214395 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:19.511086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf36e-2378-442d-abd9-cb8249214395 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:19.511350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf36e-2378-442d-abd9-cb8249214395 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:19.511970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bf36e-2378-442d-abd9-cb8249214395 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:19.512264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bf36e-2378-442d-abd9-cb8249214395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:19.513648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bf36e-2378-442d-abd9-cb8249214395 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:19.519186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 375/740] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:15:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:19.525428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b96fd7-bf79-47d9-9be7-f813a3b2b798 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:19.642388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b96fd7-bf79-47d9-9be7-f813a3b2b798 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:19.677662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29291cd7-8bd9-49d8-a1fc-9a6fedba06af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:19.678689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29291cd7-8bd9-49d8-a1fc-9a6fedba06af None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:19.679234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29291cd7-8bd9-49d8-a1fc-9a6fedba06af None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:19.680342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29291cd7-8bd9-49d8-a1fc-9a6fedba06af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:19.681265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29291cd7-8bd9-49d8-a1fc-9a6fedba06af None admin] RBAC: Adding query filter params (interface=admin, service_id=34684bcd721345e484882e587b28bcef, region_id=RegionOne) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:19.681773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29291cd7-8bd9-49d8-a1fc-9a6fedba06af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:19.683377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29291cd7-8bd9-49d8-a1fc-9a6fedba06af None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:19.687992 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459d45-89c9-4add-a6e7-b9ae02d6e838 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:19.688281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459d45-89c9-4add-a6e7-b9ae02d6e838 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:19.688556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459d45-89c9-4add-a6e7-b9ae02d6e838 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:19.689917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 376/741] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:19.695643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 366/742] 10.222.0.13 () {56 vars in 1249 bytes} [Wed Nov 2 07:15:19 2022] GET /identity/v3/endpoints?service_id=34684bcd721345e484882e587b28bcef&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:19.700095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33d8d5-70e8-4726-a870-40e226f217f7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:19.700095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33d8d5-70e8-4726-a870-40e226f217f7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:19.700095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33d8d5-70e8-4726-a870-40e226f217f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:19.701888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29291cd7-8bd9-49d8-a1fc-9a6fedba06af None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:19.717394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4d33d8d5-70e8-4726-a870-40e226f217f7 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:19.718772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4d33d8d5-70e8-4726-a870-40e226f217f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:19.761947 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:19.800117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 377/743] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:19 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:19.817881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29291cd7-8bd9-49d8-a1fc-9a6fedba06af None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:19.855991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0da35e-a8b7-4b8d-b227-a6ac5be0f383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:19.856989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0da35e-a8b7-4b8d-b227-a6ac5be0f383 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:19.857503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0da35e-a8b7-4b8d-b227-a6ac5be0f383 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:19.857975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0da35e-a8b7-4b8d-b227-a6ac5be0f383 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:19.858777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0da35e-a8b7-4b8d-b227-a6ac5be0f383 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:19.860332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0da35e-a8b7-4b8d-b227-a6ac5be0f383 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:19.869104 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 367/744] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 07:15:19 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:15:20.073638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33d8d5-70e8-4726-a870-40e226f217f7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:20.154733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:20.180924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33d8d5-70e8-4726-a870-40e226f217f7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:20.215846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:20.216443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:20.216711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:20.216973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:20.217650 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:20.219496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:20.222072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WARNING keystone.server.flask.common [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 07:15:20.240843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.sql.core [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:15:20.240843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:15:20.240843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [parameters: {'id': 'e242ae1123e2420e8d56e93e5dee6a66', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 07:15:20.240843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81559) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e242ae1123e2420e8d56e93e5dee6a66.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e242ae1123e2420e8d56e93e5dee6a66. Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:15:20.249451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result.read() Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:15:20.250270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application yield resource Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise self.value Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application session.commit() Nov 02 07:15:20.251235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:15:20.252132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:15:20.253735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result.read() Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:15:20.255666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [parameters: {'id': 'e242ae1123e2420e8d56e93e5dee6a66', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:20.257230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:20.259939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:20.267323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:20.267323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Nov 02 07:15:20.267323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Nov 02 07:15:20.267323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:20.267323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:20.267323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:15:20.267323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:15:20.267323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e242ae1123e2420e8d56e93e5dee6a66. Nov 02 07:15:20.267323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:20.267323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 378/745] 10.222.0.13 () {60 vars in 1140 bytes} [Wed Nov 2 07:15:20 2022] POST /identity/v3/projects => generated 262 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:20.268711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0da35e-a8b7-4b8d-b227-a6ac5be0f383 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:20.370878 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0da35e-a8b7-4b8d-b227-a6ac5be0f383 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:20.389698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:20.411585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747864c-8e18-4db1-86fb-1f441fadf953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:20.412567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747864c-8e18-4db1-86fb-1f441fadf953 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:20.413089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747864c-8e18-4db1-86fb-1f441fadf953 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:20.413569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747864c-8e18-4db1-86fb-1f441fadf953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:20.421625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747864c-8e18-4db1-86fb-1f441fadf953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:20.423304 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747864c-8e18-4db1-86fb-1f441fadf953 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d747864c-8e18-4db1-86fb-1f441fadf953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:15:20.436278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:20.437349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:20.438351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:15:20.438351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:15:20.438351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:15:20.438351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:15:20.438351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:15:20.438351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:15:20.438351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:20.438351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:20.440758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 368/746] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:20.446678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:20.555922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a93a0-5042-44e9-a8e8-8e88e74dcc2a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:20.589751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:20.591550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6fbf2-e638-4db5-82e9-e9c2d5a3936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:20.592468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fbf2-e638-4db5-82e9-e9c2d5a3936d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:20.592820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fbf2-e638-4db5-82e9-e9c2d5a3936d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:20.593373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fbf2-e638-4db5-82e9-e9c2d5a3936d None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:20.594072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6fbf2-e638-4db5-82e9-e9c2d5a3936d None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:20.594370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6fbf2-e638-4db5-82e9-e9c2d5a3936d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:20.596134 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6fbf2-e638-4db5-82e9-e9c2d5a3936d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:20.625249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 379/747] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:15:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:20.861529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd92aa-384a-45ad-9c51-279ad1ff116e None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:20.861822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd92aa-384a-45ad-9c51-279ad1ff116e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:20.862062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd92aa-384a-45ad-9c51-279ad1ff116e None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:20.863689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 369/748] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:20.869610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd022b55-c284-4d65-b218-1d6bfd665ce7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:20.869887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd022b55-c284-4d65-b218-1d6bfd665ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:20.870157 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd022b55-c284-4d65-b218-1d6bfd665ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:20.890328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cd022b55-c284-4d65-b218-1d6bfd665ce7 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:20.891778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cd022b55-c284-4d65-b218-1d6bfd665ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:20.962889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 380/749] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:20 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:21.231881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd92aa-384a-45ad-9c51-279ad1ff116e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:21.349359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd92aa-384a-45ad-9c51-279ad1ff116e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:21.388345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d12b-5a0e-4682-be83-165db6d63664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:21.389407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d12b-5a0e-4682-be83-165db6d63664 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:21.389898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d12b-5a0e-4682-be83-165db6d63664 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:21.390373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d12b-5a0e-4682-be83-165db6d63664 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:21.391187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510d12b-5a0e-4682-be83-165db6d63664 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:21.392756 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510d12b-5a0e-4682-be83-165db6d63664 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3510d12b-5a0e-4682-be83-165db6d63664 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:21.403034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:21.404161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:15:21.404990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:21.407837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 370/750] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:21.413373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd022b55-c284-4d65-b218-1d6bfd665ce7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:21.433950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63c44-06a7-4456-a806-1a067ff950d0 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:21.434248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63c44-06a7-4456-a806-1a067ff950d0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:21.434480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63c44-06a7-4456-a806-1a067ff950d0 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:21.435798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 371/751] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:15:21.440777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91beb60a-66a6-4475-90f5-3601a139a8a0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:21.441078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91beb60a-66a6-4475-90f5-3601a139a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:21.441351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91beb60a-66a6-4475-90f5-3601a139a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:21.460592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-91beb60a-66a6-4475-90f5-3601a139a8a0 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:21.461944 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-91beb60a-66a6-4475-90f5-3601a139a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:21.501440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:21.524693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd022b55-c284-4d65-b218-1d6bfd665ce7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:21.544305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 372/752] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:21 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:21.549880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:21.565270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02190fb4-f7ad-4a5d-a8a4-f32fa4358a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:21.566126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02190fb4-f7ad-4a5d-a8a4-f32fa4358a7d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:21.566550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02190fb4-f7ad-4a5d-a8a4-f32fa4358a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:21.566966 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02190fb4-f7ad-4a5d-a8a4-f32fa4358a7d None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:21.567799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02190fb4-f7ad-4a5d-a8a4-f32fa4358a7d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:21.568243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02190fb4-f7ad-4a5d-a8a4-f32fa4358a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:21.569783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02190fb4-f7ad-4a5d-a8a4-f32fa4358a7d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:21.575973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 381/753] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:15:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:21.581739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91beb60a-66a6-4475-90f5-3601a139a8a0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:21.688947 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91beb60a-66a6-4475-90f5-3601a139a8a0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:21.729102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1cb34-132b-4808-b819-33b0f30f58cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:21.729707 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1cb34-132b-4808-b819-33b0f30f58cd None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:21.729978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1cb34-132b-4808-b819-33b0f30f58cd None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:21.730244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1cb34-132b-4808-b819-33b0f30f58cd None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:21.730867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1cb34-132b-4808-b819-33b0f30f58cd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:21.731162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1cb34-132b-4808-b819-33b0f30f58cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:21.732513 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1cb34-132b-4808-b819-33b0f30f58cd None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:21.737892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 373/754] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:15:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:21.744405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02190fb4-f7ad-4a5d-a8a4-f32fa4358a7d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:21.849632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02190fb4-f7ad-4a5d-a8a4-f32fa4358a7d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:21.883465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1cb34-132b-4808-b819-33b0f30f58cd None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:21.888149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3dc1-3e71-45cc-9100-c17137e0775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:21.888763 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3dc1-3e71-45cc-9100-c17137e0775a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:21.889076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3dc1-3e71-45cc-9100-c17137e0775a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:21.889346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e3dc1-3e71-45cc-9100-c17137e0775a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:21.890044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e3dc1-3e71-45cc-9100-c17137e0775a None admin] RBAC: Adding query filter params (interface=public, service_id=467eeb578ae04d24898d1341aa01786d, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:21.890347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e3dc1-3e71-45cc-9100-c17137e0775a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:21.891698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e3dc1-3e71-45cc-9100-c17137e0775a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:21.899071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 382/755] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 07:15:21 2022] GET /identity/v3/endpoints?service_id=467eeb578ae04d24898d1341aa01786d&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:21.904999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3dc1-3e71-45cc-9100-c17137e0775a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:21.940459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:21.971820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:22.024358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1cb34-132b-4808-b819-33b0f30f58cd None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:22.038598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e3dc1-3e71-45cc-9100-c17137e0775a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:22.060013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1aab4-9954-4143-abe2-bbbc88ae86d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:22.060560 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1aab4-9954-4143-abe2-bbbc88ae86d2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.060832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1aab4-9954-4143-abe2-bbbc88ae86d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.061172 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1aab4-9954-4143-abe2-bbbc88ae86d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.061740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1aab4-9954-4143-abe2-bbbc88ae86d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:22.063095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1aab4-9954-4143-abe2-bbbc88ae86d2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-6fa1aab4-9954-4143-abe2-bbbc88ae86d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:22.073003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:22.074033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:22.074900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 374/756] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Nov 2 07:15:21 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:22.081403 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1aab4-9954-4143-abe2-bbbc88ae86d2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:22.090852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0808b1-7959-4f2c-abe6-a5df96dfabc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:22.091512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0808b1-7959-4f2c-abe6-a5df96dfabc9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.091783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0808b1-7959-4f2c-abe6-a5df96dfabc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.092044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0808b1-7959-4f2c-abe6-a5df96dfabc9 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.092698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0808b1-7959-4f2c-abe6-a5df96dfabc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:22.094900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0808b1-7959-4f2c-abe6-a5df96dfabc9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:22.108841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 383/757] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 07:15:21 2022] GET /identity/v3/services => generated 1957 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:15:22.206476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:22.212374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1aab4-9954-4143-abe2-bbbc88ae86d2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:22.246870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fcd3d-eb84-45c4-97ac-0ffd198ed7e8 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.247500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fcd3d-eb84-45c4-97ac-0ffd198ed7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.248062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fcd3d-eb84-45c4-97ac-0ffd198ed7e8 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.250150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 384/758] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:22.255686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2e76d-b6b5-4494-8ff8-0077593500c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:22.256303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2e76d-b6b5-4494-8ff8-0077593500c7 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.256581 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2e76d-b6b5-4494-8ff8-0077593500c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.256856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2e76d-b6b5-4494-8ff8-0077593500c7 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.256961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00160a-8df9-45c9-8e3d-e4bbaa59e05a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.258075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2e76d-b6b5-4494-8ff8-0077593500c7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:22.258370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00160a-8df9-45c9-8e3d-e4bbaa59e05a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.258840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00160a-8df9-45c9-8e3d-e4bbaa59e05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.259024 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2e76d-b6b5-4494-8ff8-0077593500c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:22.260468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2e76d-b6b5-4494-8ff8-0077593500c7 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:22.269102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 375/759] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:22.272424 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2e76d-b6b5-4494-8ff8-0077593500c7 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:22.286809 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6f00160a-8df9-45c9-8e3d-e4bbaa59e05a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:22.288618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6f00160a-8df9-45c9-8e3d-e4bbaa59e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:22.389390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2e76d-b6b5-4494-8ff8-0077593500c7 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:22.392912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 385/760] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:22 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:22.431501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77acad1-79d0-4c8e-b41a-5372a9768eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:22.432502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77acad1-79d0-4c8e-b41a-5372a9768eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.433027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77acad1-79d0-4c8e-b41a-5372a9768eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.433511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77acad1-79d0-4c8e-b41a-5372a9768eb8 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.434367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77acad1-79d0-4c8e-b41a-5372a9768eb8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:22.434874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77acad1-79d0-4c8e-b41a-5372a9768eb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:22.436437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77acad1-79d0-4c8e-b41a-5372a9768eb8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:22.442188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 376/761] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:22.448291 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00160a-8df9-45c9-8e3d-e4bbaa59e05a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:22.499831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:22.561653 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00160a-8df9-45c9-8e3d-e4bbaa59e05a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:22.600056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a94d3-d8b5-46c1-a0ac-94a81ca79e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:22.601075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a94d3-d8b5-46c1-a0ac-94a81ca79e51 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.602225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a94d3-d8b5-46c1-a0ac-94a81ca79e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.602726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a94d3-d8b5-46c1-a0ac-94a81ca79e51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.603627 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a94d3-d8b5-46c1-a0ac-94a81ca79e51 None admin] RBAC: Adding query filter params (interface=public, service_id=9187b8bc01764df59a1730107e6e185f, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:22.604136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a94d3-d8b5-46c1-a0ac-94a81ca79e51 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:22.605756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a94d3-d8b5-46c1-a0ac-94a81ca79e51 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:22.611929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 386/762] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 07:15:22 2022] GET /identity/v3/endpoints?service_id=9187b8bc01764df59a1730107e6e185f&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:22.619235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77acad1-79d0-4c8e-b41a-5372a9768eb8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:22.650938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:22.700347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a94d3-d8b5-46c1-a0ac-94a81ca79e51 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:22.738245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77acad1-79d0-4c8e-b41a-5372a9768eb8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:22.784021 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aaac6-7a5d-4262-a08b-2f5d21a0f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:22.785003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aaac6-7a5d-4262-a08b-2f5d21a0f575 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.785510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aaac6-7a5d-4262-a08b-2f5d21a0f575 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.785982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aaac6-7a5d-4262-a08b-2f5d21a0f575 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.786814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aaac6-7a5d-4262-a08b-2f5d21a0f575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:22.788804 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aaac6-7a5d-4262-a08b-2f5d21a0f575 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:22.803872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 377/763] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 07:15:22 2022] GET /identity/v3/services => generated 1957 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:15:22.818777 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a94d3-d8b5-46c1-a0ac-94a81ca79e51 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:22.828395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:22.864011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a28ca1-63f0-46ab-8164-305269bd1d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:22.864660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28ca1-63f0-46ab-8164-305269bd1d30 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.864939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28ca1-63f0-46ab-8164-305269bd1d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.865242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28ca1-63f0-46ab-8164-305269bd1d30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.865831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a28ca1-63f0-46ab-8164-305269bd1d30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:22.867853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a28ca1-63f0-46ab-8164-305269bd1d30 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-42a28ca1-63f0-46ab-8164-305269bd1d30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:22.877944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:22.879006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:22.879848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 387/764] 10.222.0.13 () {56 vars in 1126 bytes} [Wed Nov 2 07:15:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:22.885779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aaac6-7a5d-4262-a08b-2f5d21a0f575 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:22.961991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314c00-da4c-4aaa-aa0e-7075f0053152 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.962322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314c00-da4c-4aaa-aa0e-7075f0053152 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.962544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314c00-da4c-4aaa-aa0e-7075f0053152 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.965501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 388/765] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:22.970340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a41ac0-a632-4f80-8184-8e5950d536a6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:22.970617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a41ac0-a632-4f80-8184-8e5950d536a6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:22.970882 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a41ac0-a632-4f80-8184-8e5950d536a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:22.991686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-49a41ac0-a632-4f80-8184-8e5950d536a6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:22.994076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-49a41ac0-a632-4f80-8184-8e5950d536a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:23.009093 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:23.019985 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aaac6-7a5d-4262-a08b-2f5d21a0f575 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:23.063310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e2f2f-fe2e-45cf-a726-879338678f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:23.063998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e2f2f-fe2e-45cf-a726-879338678f09 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:23.064224 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e2f2f-fe2e-45cf-a726-879338678f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:23.064474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e2f2f-fe2e-45cf-a726-879338678f09 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:23.065547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e2f2f-fe2e-45cf-a726-879338678f09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:23.065547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e2f2f-fe2e-45cf-a726-879338678f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:23.068044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e2f2f-fe2e-45cf-a726-879338678f09 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:23.080599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 378/766] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:15:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:23.081982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e2f2f-fe2e-45cf-a726-879338678f09 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:23.105133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 389/767] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:22 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:23.190394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e2f2f-fe2e-45cf-a726-879338678f09 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:23.228340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16474390-0a3c-4413-9c42-922fc8d8ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:23.229391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16474390-0a3c-4413-9c42-922fc8d8ee8b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:23.229891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16474390-0a3c-4413-9c42-922fc8d8ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:23.230401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16474390-0a3c-4413-9c42-922fc8d8ee8b None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:23.231224 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16474390-0a3c-4413-9c42-922fc8d8ee8b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:23.231741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16474390-0a3c-4413-9c42-922fc8d8ee8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:23.233333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16474390-0a3c-4413-9c42-922fc8d8ee8b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:23.239038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 379/768] 10.222.0.13 () {56 vars in 1122 bytes} [Wed Nov 2 07:15:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:23.245591 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a41ac0-a632-4f80-8184-8e5950d536a6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:23.352841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a41ac0-a632-4f80-8184-8e5950d536a6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:23.360542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:23.389286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05a82a-59ba-43db-ad40-bb37dc50981b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:23.389891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05a82a-59ba-43db-ad40-bb37dc50981b None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:23.390168 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05a82a-59ba-43db-ad40-bb37dc50981b None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:23.390435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05a82a-59ba-43db-ad40-bb37dc50981b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:23.391093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05a82a-59ba-43db-ad40-bb37dc50981b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:23.392457 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05a82a-59ba-43db-ad40-bb37dc50981b None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:23.407898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16474390-0a3c-4413-9c42-922fc8d8ee8b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:23.412762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 390/769] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:15:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:23.438845 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:23.535192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16474390-0a3c-4413-9c42-922fc8d8ee8b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:23.585249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:23.586842 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:23.587351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:23.587818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:23.588700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:23.590433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:23.593640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING keystone.server.flask.common [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 07:15:23.607973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.sql.core [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:15:23.607973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 07:15:23.607973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [parameters: {'user_id': '2aa82306f1014c21abd4b83516e62382', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 07:15:23.607973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81558) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result.read() Nov 02 07:15:23.616358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:15:23.617392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application yield resource Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise self.value Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application session.commit() Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:15:23.618358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:15:23.619239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result = connection._execute_20( Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:15:23.620155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application result.read() Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:15:23.621872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [parameters: {'user_id': '2aa82306f1014c21abd4b83516e62382', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:23.623872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Nov 02 07:15:23.625791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Nov 02 07:15:23.627952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Nov 02 07:15:23.627952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Nov 02 07:15:23.627952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:15:23.627952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:15:23.627952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 07:15:23.627952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:23.630637 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 380/770] 10.222.0.13 () {60 vars in 1131 bytes} [Wed Nov 2 07:15:23 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:23.636846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05a82a-59ba-43db-ad40-bb37dc50981b None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:23.753236 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05a82a-59ba-43db-ad40-bb37dc50981b None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:23.794740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f4c54-47a1-43d6-9da5-d9c629bfede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:23.795306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f4c54-47a1-43d6-9da5-d9c629bfede5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:23.795638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f4c54-47a1-43d6-9da5-d9c629bfede5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:23.795912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f4c54-47a1-43d6-9da5-d9c629bfede5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:23.805303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f4c54-47a1-43d6-9da5-d9c629bfede5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:23.806842 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f4c54-47a1-43d6-9da5-d9c629bfede5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-690f4c54-47a1-43d6-9da5-d9c629bfede5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:15:23.818739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:23.820940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:23.822228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 391/771] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:15:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:23.825933 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:23.916482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:23.943874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e3a8d-f27e-44bb-b7ec-699a3842fc22 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:23.980197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bf233-5d70-4ec4-b229-e97b12010137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:23.981206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bf233-5d70-4ec4-b229-e97b12010137 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:23.981710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bf233-5d70-4ec4-b229-e97b12010137 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:23.982201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bf233-5d70-4ec4-b229-e97b12010137 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:23.983107 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bf233-5d70-4ec4-b229-e97b12010137 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:23.983622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bf233-5d70-4ec4-b229-e97b12010137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:23.985466 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bf233-5d70-4ec4-b229-e97b12010137 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:24.025927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 381/772] 10.222.0.13 () {56 vars in 1101 bytes} [Wed Nov 2 07:15:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:24.359164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1648f-ec28-4138-91dc-8d4f825ee7f4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:24.359523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1648f-ec28-4138-91dc-8d4f825ee7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:24.359696 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1648f-ec28-4138-91dc-8d4f825ee7f4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:24.361179 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 392/773] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:24.366252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5d913-8ea8-42c7-9bdd-fb855ff04f6f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:24.366536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5d913-8ea8-42c7-9bdd-fb855ff04f6f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:24.366833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5d913-8ea8-42c7-9bdd-fb855ff04f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:24.385608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-94f5d913-8ea8-42c7-9bdd-fb855ff04f6f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:24.387094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-94f5d913-8ea8-42c7-9bdd-fb855ff04f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:24.456470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 382/774] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:24 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:24.727609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1648f-ec28-4138-91dc-8d4f825ee7f4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:24.752413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:24.836464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1648f-ec28-4138-91dc-8d4f825ee7f4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:24.871126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1813d-2147-4afe-bbb7-3e444ee4fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:24.871984 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1813d-2147-4afe-bbb7-3e444ee4fc47 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:24.872409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1813d-2147-4afe-bbb7-3e444ee4fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:24.872842 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1813d-2147-4afe-bbb7-3e444ee4fc47 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:24.873598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1813d-2147-4afe-bbb7-3e444ee4fc47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:24.875289 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1813d-2147-4afe-bbb7-3e444ee4fc47 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-dff1813d-2147-4afe-bbb7-3e444ee4fc47 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:24.884516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:24.885734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:15:24.886774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:24.889102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 393/775] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:24.894688 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5d913-8ea8-42c7-9bdd-fb855ff04f6f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:24.960202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:25.002854 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5d913-8ea8-42c7-9bdd-fb855ff04f6f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:25.039988 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f4c0d-dd30-4b6c-b2fa-b17e0f733389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:25.040594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f4c0d-dd30-4b6c-b2fa-b17e0f733389 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:25.040867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f4c0d-dd30-4b6c-b2fa-b17e0f733389 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:25.041170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f4c0d-dd30-4b6c-b2fa-b17e0f733389 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:25.041793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f4c0d-dd30-4b6c-b2fa-b17e0f733389 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:25.042088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f4c0d-dd30-4b6c-b2fa-b17e0f733389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:25.043449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f4c0d-dd30-4b6c-b2fa-b17e0f733389 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:25.053050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 383/776] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:15:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:25.054255 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1813d-2147-4afe-bbb7-3e444ee4fc47 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:25.117669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf09d1-4d31-490b-af76-52aff0e1a83e None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:25.118051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf09d1-4d31-490b-af76-52aff0e1a83e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:25.118395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf09d1-4d31-490b-af76-52aff0e1a83e None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:25.119722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 384/777] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:15:25.124767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac36f7d-c97a-497a-b19d-4f4dff1e88d1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:25.125061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac36f7d-c97a-497a-b19d-4f4dff1e88d1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:25.125333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac36f7d-c97a-497a-b19d-4f4dff1e88d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:25.145109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-aac36f7d-c97a-497a-b19d-4f4dff1e88d1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:25.146296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aac36f7d-c97a-497a-b19d-4f4dff1e88d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:25.146459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:25.164383 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1813d-2147-4afe-bbb7-3e444ee4fc47 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:25.200656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e5b30-3f50-4bf7-b57a-ae0c1ead2ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:25.201059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e5b30-3f50-4bf7-b57a-ae0c1ead2ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:25.201338 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e5b30-3f50-4bf7-b57a-ae0c1ead2ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:25.201609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e5b30-3f50-4bf7-b57a-ae0c1ead2ef7 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:25.202290 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e5b30-3f50-4bf7-b57a-ae0c1ead2ef7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:25.202528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e5b30-3f50-4bf7-b57a-ae0c1ead2ef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:25.203909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e5b30-3f50-4bf7-b57a-ae0c1ead2ef7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:25.208893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 394/778] 10.222.0.13 () {56 vars in 1112 bytes} [Wed Nov 2 07:15:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:25.214306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e5b30-3f50-4bf7-b57a-ae0c1ead2ef7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:25.223268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 385/779] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:25 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:25.317209 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e5b30-3f50-4bf7-b57a-ae0c1ead2ef7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:25.353808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ac34b-e426-48e6-a5ad-d2970a483c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:25.354413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ac34b-e426-48e6-a5ad-d2970a483c8e None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:25.354693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ac34b-e426-48e6-a5ad-d2970a483c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:25.354962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ac34b-e426-48e6-a5ad-d2970a483c8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:25.355621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ac34b-e426-48e6-a5ad-d2970a483c8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:25.356980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ac34b-e426-48e6-a5ad-d2970a483c8e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:25.377295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 395/780] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:15:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:15:25.502829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac36f7d-c97a-497a-b19d-4f4dff1e88d1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:25.568504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:25.618993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac36f7d-c97a-497a-b19d-4f4dff1e88d1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:25.664258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac606823-18a2-4713-bf56-8ca50612820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:25.664890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac606823-18a2-4713-bf56-8ca50612820e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:25.665464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac606823-18a2-4713-bf56-8ca50612820e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:25.665736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac606823-18a2-4713-bf56-8ca50612820e None admin] PATH_INFO: `/v3/services/image` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:25.666312 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac606823-18a2-4713-bf56-8ca50612820e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:25.667648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac606823-18a2-4713-bf56-8ca50612820e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-ac606823-18a2-4713-bf56-8ca50612820e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:25.676550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:25.677734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:25.679064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 386/781] 10.222.0.13 () {56 vars in 1105 bytes} [Wed Nov 2 07:15:25 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:25.684791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ac34b-e426-48e6-a5ad-d2970a483c8e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:25.688672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:25.728135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9196df-3625-42e9-80e0-f5566c6ca49d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:25.728404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9196df-3625-42e9-80e0-f5566c6ca49d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:25.728663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9196df-3625-42e9-80e0-f5566c6ca49d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:25.730154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 387/782] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:15:25.735037 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7313-7289-4721-8216-fdd360b7d355 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:25.735315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7313-7289-4721-8216-fdd360b7d355 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:25.735577 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe7313-7289-4721-8216-fdd360b7d355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:25.753585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-dffe7313-7289-4721-8216-fdd360b7d355 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:25.754755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dffe7313-7289-4721-8216-fdd360b7d355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:25.800068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ac34b-e426-48e6-a5ad-d2970a483c8e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:25.827911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 388/783] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:25.836952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4559018-1e78-47fd-bd72-7001e553f1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:25.837584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4559018-1e78-47fd-bd72-7001e553f1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:25.837860 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4559018-1e78-47fd-bd72-7001e553f1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:25.838135 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4559018-1e78-47fd-bd72-7001e553f1c3 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:25.838757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4559018-1e78-47fd-bd72-7001e553f1c3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:25.839055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4559018-1e78-47fd-bd72-7001e553f1c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:25.840402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4559018-1e78-47fd-bd72-7001e553f1c3 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:25.850499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 396/784] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:25.851817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe7313-7289-4721-8216-fdd360b7d355 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:25.906056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:25.961600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe7313-7289-4721-8216-fdd360b7d355 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:25.997762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd433be2-2459-4419-a464-cbc9aa35801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:25.998367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd433be2-2459-4419-a464-cbc9aa35801b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:25.998645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd433be2-2459-4419-a464-cbc9aa35801b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:25.998916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd433be2-2459-4419-a464-cbc9aa35801b None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:25.999540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd433be2-2459-4419-a464-cbc9aa35801b None admin] RBAC: Adding query filter params (type=image) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:25.999839 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd433be2-2459-4419-a464-cbc9aa35801b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:26.001243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd433be2-2459-4419-a464-cbc9aa35801b None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:26.006301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 389/785] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:26.012394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4559018-1e78-47fd-bd72-7001e553f1c3 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:26.080273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:26.098600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd433be2-2459-4419-a464-cbc9aa35801b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:26.119526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4559018-1e78-47fd-bd72-7001e553f1c3 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:26.154731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807290b-8561-445e-ab7c-c14aebc499aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:26.155336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807290b-8561-445e-ab7c-c14aebc499aa None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:26.155614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807290b-8561-445e-ab7c-c14aebc499aa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:26.155885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807290b-8561-445e-ab7c-c14aebc499aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:26.156544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807290b-8561-445e-ab7c-c14aebc499aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:26.158445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807290b-8561-445e-ab7c-c14aebc499aa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:26.181923 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 397/786] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:15:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:15:26.217693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd433be2-2459-4419-a464-cbc9aa35801b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:26.233665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:26.267341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61917e-afb9-472e-acd0-afdeadbda352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:26.267828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61917e-afb9-472e-acd0-afdeadbda352 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:26.268145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61917e-afb9-472e-acd0-afdeadbda352 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:26.268419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61917e-afb9-472e-acd0-afdeadbda352 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:26.269586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61917e-afb9-472e-acd0-afdeadbda352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:26.271049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61917e-afb9-472e-acd0-afdeadbda352 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:26.272839 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 390/787] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:26.279292 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807290b-8561-445e-ab7c-c14aebc499aa None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:26.389461 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807290b-8561-445e-ab7c-c14aebc499aa None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:26.413476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:26.424919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5518e0d-2aa1-4cd7-a098-189f5d294ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:26.425555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5518e0d-2aa1-4cd7-a098-189f5d294ac1 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:26.425827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5518e0d-2aa1-4cd7-a098-189f5d294ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:26.426089 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5518e0d-2aa1-4cd7-a098-189f5d294ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:26.426735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5518e0d-2aa1-4cd7-a098-189f5d294ac1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:26.428135 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5518e0d-2aa1-4cd7-a098-189f5d294ac1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:26.456668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 398/788] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:15:26 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:27.635316 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda12fc-8ecb-430c-857b-f66a16ed3290 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:27.635848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda12fc-8ecb-430c-857b-f66a16ed3290 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:27.635848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda12fc-8ecb-430c-857b-f66a16ed3290 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:27.637238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 391/789] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:27.642268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a618574-b8f0-47a5-a0b8-9964e7133d51 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:27.642662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a618574-b8f0-47a5-a0b8-9964e7133d51 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:27.642853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a618574-b8f0-47a5-a0b8-9964e7133d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:27.661822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3a618574-b8f0-47a5-a0b8-9964e7133d51 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:27.663007 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3a618574-b8f0-47a5-a0b8-9964e7133d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:27.733042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 399/790] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:28.000051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda12fc-8ecb-430c-857b-f66a16ed3290 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:28.104710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda12fc-8ecb-430c-857b-f66a16ed3290 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:28.138286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628816b-9073-499a-9be7-aa67fd9fb92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:28.138900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628816b-9073-499a-9be7-aa67fd9fb92b None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:28.139171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628816b-9073-499a-9be7-aa67fd9fb92b None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:28.139435 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628816b-9073-499a-9be7-aa67fd9fb92b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:28.150031 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628816b-9073-499a-9be7-aa67fd9fb92b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-7628816b-9073-499a-9be7-aa67fd9fb92b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:15:28.154718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:28.155625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:15:28.156462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:28.160725 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 392/791] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 07:15:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:28.162120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a618574-b8f0-47a5-a0b8-9964e7133d51 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:28.262504 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a618574-b8f0-47a5-a0b8-9964e7133d51 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:28.269772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:28.302866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd27037-5501-4ddb-918e-7414a3b81805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:28.303485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd27037-5501-4ddb-918e-7414a3b81805 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:28.303761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd27037-5501-4ddb-918e-7414a3b81805 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:28.304027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd27037-5501-4ddb-918e-7414a3b81805 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:28.304746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd27037-5501-4ddb-918e-7414a3b81805 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:28.305078 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd27037-5501-4ddb-918e-7414a3b81805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:28.306469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd27037-5501-4ddb-918e-7414a3b81805 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:28.315559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 400/792] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Nov 2 07:15:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:28.322000 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628816b-9073-499a-9be7-aa67fd9fb92b None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:28.359252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:28.402249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8fb5b-023c-45a6-ba28-a5d6fbdf5ed0 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:28.402594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8fb5b-023c-45a6-ba28-a5d6fbdf5ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:28.402800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8fb5b-023c-45a6-ba28-a5d6fbdf5ed0 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:28.404288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 401/793] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:15:28.409508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae161f-36f0-4db8-9ac2-9f393ab655d0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:28.409793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae161f-36f0-4db8-9ac2-9f393ab655d0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:28.410094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae161f-36f0-4db8-9ac2-9f393ab655d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:28.429968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7aae161f-36f0-4db8-9ac2-9f393ab655d0 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:28.430761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628816b-9073-499a-9be7-aa67fd9fb92b None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:28.431147 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7aae161f-36f0-4db8-9ac2-9f393ab655d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:28.464889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1636-cfb0-40cb-a9bd-cafb879df6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:28.465904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1636-cfb0-40cb-a9bd-cafb879df6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:28.466493 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1636-cfb0-40cb-a9bd-cafb879df6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:28.467031 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1636-cfb0-40cb-a9bd-cafb879df6b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:28.478271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1636-cfb0-40cb-a9bd-cafb879df6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:28.479963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1636-cfb0-40cb-a9bd-cafb879df6b8 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d40d1636-cfb0-40cb-a9bd-cafb879df6b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:28.494922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:28.495895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:28.496822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:28.496822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:28.496822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:28.498896 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 393/794] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:28.504234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1636-cfb0-40cb-a9bd-cafb879df6b8 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:28.508133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 402/795] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:28.603980 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:28.617602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1636-cfb0-40cb-a9bd-cafb879df6b8 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:28.653178 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da8874-5147-405e-9ebc-c84bf7a192de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:28.654562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da8874-5147-405e-9ebc-c84bf7a192de None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:28.655041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da8874-5147-405e-9ebc-c84bf7a192de None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:28.655544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da8874-5147-405e-9ebc-c84bf7a192de None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:28.656402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da8874-5147-405e-9ebc-c84bf7a192de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:28.656901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da8874-5147-405e-9ebc-c84bf7a192de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:28.658484 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da8874-5147-405e-9ebc-c84bf7a192de None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:28.671304 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 394/796] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:28.676558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c820-72ec-4276-95c5-cdf40bd9eec1 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:28.677035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c820-72ec-4276-95c5-cdf40bd9eec1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:28.677119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c820-72ec-4276-95c5-cdf40bd9eec1 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:28.677212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da8874-5147-405e-9ebc-c84bf7a192de None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:28.678536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 403/797] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:28.684172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0ad27-ed82-41ca-bde1-9f7475362943 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:28.684534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0ad27-ed82-41ca-bde1-9f7475362943 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:28.684907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0ad27-ed82-41ca-bde1-9f7475362943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:28.703406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4de0ad27-ed82-41ca-bde1-9f7475362943 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:28.704680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4de0ad27-ed82-41ca-bde1-9f7475362943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:28.772540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 404/798] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:15:28.781338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da8874-5147-405e-9ebc-c84bf7a192de None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:28.781962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0ad27-ed82-41ca-bde1-9f7475362943 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:28.810505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:28.815730 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57486e46-b219-4bb3-bef0-1527649ec9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:28.816358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486e46-b219-4bb3-bef0-1527649ec9bb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:28.816631 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486e46-b219-4bb3-bef0-1527649ec9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:28.816895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486e46-b219-4bb3-bef0-1527649ec9bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:28.824294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57486e46-b219-4bb3-bef0-1527649ec9bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:28.825793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57486e46-b219-4bb3-bef0-1527649ec9bb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-57486e46-b219-4bb3-bef0-1527649ec9bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:15:28.838498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:28.839485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:28.840427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 395/799] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 07:15:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:28.845649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57486e46-b219-4bb3-bef0-1527649ec9bb None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:28.863360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:28.899828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0ad27-ed82-41ca-bde1-9f7475362943 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:28.939959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd93fc-bbf4-4b4e-88a5-4772a10e7e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:28.940589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd93fc-bbf4-4b4e-88a5-4772a10e7e57 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:28.940912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd93fc-bbf4-4b4e-88a5-4772a10e7e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:28.941214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd93fc-bbf4-4b4e-88a5-4772a10e7e57 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:28.941868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd93fc-bbf4-4b4e-88a5-4772a10e7e57 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:28.943241 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd93fc-bbf4-4b4e-88a5-4772a10e7e57 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:28.951451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.sql.core [None req-00bd93fc-bbf4-4b4e-88a5-4772a10e7e57 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:15:28.951451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:15:28.951451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [parameters: {'id': '2ec732d596a64615ab52724687809205', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:15:28.951451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81559) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-00bd93fc-bbf4-4b4e-88a5-4772a10e7e57 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:15:28.958538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result.read() Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:15:28.959397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application yield resource Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise self.value Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application session.commit() Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:15:28.960402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:15:28.962004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:15:28.962916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application result.read() Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:15:28.963711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [parameters: {'id': '2ec732d596a64615ab52724687809205', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:15:28.964570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:28.967618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 405/800] 10.222.0.13 () {60 vars in 1137 bytes} [Wed Nov 2 07:15:28 2022] POST /identity/v3/domains => generated 190 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:28.971149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd93fc-bbf4-4b4e-88a5-4772a10e7e57 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:28.973922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57486e46-b219-4bb3-bef0-1527649ec9bb None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:29.011466 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbcdda-612c-44c5-ac85-397ee8c8f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:29.012512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbcdda-612c-44c5-ac85-397ee8c8f0ff None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:29.012793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbcdda-612c-44c5-ac85-397ee8c8f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:29.013092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbcdda-612c-44c5-ac85-397ee8c8f0ff None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:29.013844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbcdda-612c-44c5-ac85-397ee8c8f0ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:29.014144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbcdda-612c-44c5-ac85-397ee8c8f0ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:29.015907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbcdda-612c-44c5-ac85-397ee8c8f0ff None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:29.039026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 396/801] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 07:15:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:29.040365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbcdda-612c-44c5-ac85-397ee8c8f0ff None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:29.070562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:29.080169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd93fc-bbf4-4b4e-88a5-4772a10e7e57 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:29.107744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:29.114391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3e49-34c5-477f-aa5c-6c0471926f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:29.114955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3e49-34c5-477f-aa5c-6c0471926f6a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:29.115227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3e49-34c5-477f-aa5c-6c0471926f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:29.115492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3e49-34c5-477f-aa5c-6c0471926f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:29.125986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b3e49-34c5-477f-aa5c-6c0471926f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:29.127497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b3e49-34c5-477f-aa5c-6c0471926f6a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:29.141933 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbcdda-612c-44c5-ac85-397ee8c8f0ff None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-ee8b3e49-34c5-477f-aa5c-6c0471926f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:29.142210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:29.143335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:29.144303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:29.144303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:29.144303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:29.144303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 406/802] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:29.144303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3e49-34c5-477f-aa5c-6c0471926f6a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:29.178199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88e69-d953-417e-b62c-c75b5f3bde78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:29.178829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88e69-d953-417e-b62c-c75b5f3bde78 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:29.179109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88e69-d953-417e-b62c-c75b5f3bde78 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:29.179409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88e69-d953-417e-b62c-c75b5f3bde78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:29.189068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d88e69-d953-417e-b62c-c75b5f3bde78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:29.190502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d88e69-d953-417e-b62c-c75b5f3bde78 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-68d88e69-d953-417e-b62c-c75b5f3bde78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:29.204975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:29.206030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:29.206892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:29.206892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:29.206892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:29.206892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 397/803] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:29.206892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88e69-d953-417e-b62c-c75b5f3bde78 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:29.245769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3e49-34c5-477f-aa5c-6c0471926f6a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:29.279712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7819ec-0aa4-4fe3-8c20-56867df5b60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:29.280330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7819ec-0aa4-4fe3-8c20-56867df5b60a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:29.280605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7819ec-0aa4-4fe3-8c20-56867df5b60a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:29.280872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7819ec-0aa4-4fe3-8c20-56867df5b60a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:29.281997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7819ec-0aa4-4fe3-8c20-56867df5b60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:29.283415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7819ec-0aa4-4fe3-8c20-56867df5b60a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:29.284958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 407/804] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:29.285729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7819ec-0aa4-4fe3-8c20-56867df5b60a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:29.300789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:29.314015 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88e69-d953-417e-b62c-c75b5f3bde78 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:29.330591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:29.347987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541aa3a-efd9-43bf-b36e-85bdc4ec6309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:29.348584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541aa3a-efd9-43bf-b36e-85bdc4ec6309 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:29.348853 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541aa3a-efd9-43bf-b36e-85bdc4ec6309 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:29.349149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541aa3a-efd9-43bf-b36e-85bdc4ec6309 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:29.349809 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541aa3a-efd9-43bf-b36e-85bdc4ec6309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:29.350106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541aa3a-efd9-43bf-b36e-85bdc4ec6309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:29.351523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541aa3a-efd9-43bf-b36e-85bdc4ec6309 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:29.362982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 398/805] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:29.363743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541aa3a-efd9-43bf-b36e-85bdc4ec6309 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:29.392913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7819ec-0aa4-4fe3-8c20-56867df5b60a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:29.432311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c03e17-2f89-46d0-8b50-ce1c6e23681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:29.432922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c03e17-2f89-46d0-8b50-ce1c6e23681a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:29.433221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c03e17-2f89-46d0-8b50-ce1c6e23681a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:29.433505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c03e17-2f89-46d0-8b50-ce1c6e23681a None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:29.434125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c03e17-2f89-46d0-8b50-ce1c6e23681a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:29.434556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c03e17-2f89-46d0-8b50-ce1c6e23681a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:29.435803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c03e17-2f89-46d0-8b50-ce1c6e23681a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:29.454884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 408/806] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:29.456051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c03e17-2f89-46d0-8b50-ce1c6e23681a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:29.486033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541aa3a-efd9-43bf-b36e-85bdc4ec6309 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:29.524732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982fff7-5076-49b7-a418-960159ce3575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:29.525396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982fff7-5076-49b7-a418-960159ce3575 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:29.525666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982fff7-5076-49b7-a418-960159ce3575 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:29.525979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982fff7-5076-49b7-a418-960159ce3575 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:29.526632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982fff7-5076-49b7-a418-960159ce3575 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:29.528111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982fff7-5076-49b7-a418-960159ce3575 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:29.536417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:29.555698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 399/807] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:15:29 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:29.580998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c03e17-2f89-46d0-8b50-ce1c6e23681a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:29.625730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae89ce7-e0f8-4a2f-8473-2190d4288273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:29.626371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae89ce7-e0f8-4a2f-8473-2190d4288273 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:29.626643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae89ce7-e0f8-4a2f-8473-2190d4288273 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:29.626908 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae89ce7-e0f8-4a2f-8473-2190d4288273 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:29.634944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae89ce7-e0f8-4a2f-8473-2190d4288273 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:29.636397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae89ce7-e0f8-4a2f-8473-2190d4288273 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-fae89ce7-e0f8-4a2f-8473-2190d4288273 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:15:29.649054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:29.650200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:29.651298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:15:29.651298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:15:29.651298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:15:29.651298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:15:29.651298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:15:29.651298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:15:29.651298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:29.651298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:29.653210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 409/808] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:29.659487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982fff7-5076-49b7-a418-960159ce3575 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:29.702847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:29.775344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982fff7-5076-49b7-a418-960159ce3575 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:29.808758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53fba1-3c76-4296-a0d4-09f445d012bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:29.809387 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53fba1-3c76-4296-a0d4-09f445d012bf None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:29.809663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53fba1-3c76-4296-a0d4-09f445d012bf None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:29.809932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53fba1-3c76-4296-a0d4-09f445d012bf None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:29.810619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53fba1-3c76-4296-a0d4-09f445d012bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:29.810921 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53fba1-3c76-4296-a0d4-09f445d012bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:29.812329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53fba1-3c76-4296-a0d4-09f445d012bf None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:29.823977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 400/809] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:29.829934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae89ce7-e0f8-4a2f-8473-2190d4288273 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:29.930062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae89ce7-e0f8-4a2f-8473-2190d4288273 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:29.957980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:29.963783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c50013-d8f4-4570-a161-c3a912809ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:29.964471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c50013-d8f4-4570-a161-c3a912809ee6 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:29.964750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c50013-d8f4-4570-a161-c3a912809ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:29.965079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c50013-d8f4-4570-a161-c3a912809ee6 None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/ad0826bb58db4100b0d807fb07734deb/roles/23eea1dba0c84318a532485385fd19b2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:29.967204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c50013-d8f4-4570-a161-c3a912809ee6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=ad0826bb58db4100b0d807fb07734deb, role_id=23eea1dba0c84318a532485385fd19b2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:29.968918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c50013-d8f4-4570-a161-c3a912809ee6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:29.982795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 410/810] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:15:29 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/ad0826bb58db4100b0d807fb07734deb/roles/23eea1dba0c84318a532485385fd19b2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:15:31.742816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57e607-1779-4761-a805-176aedd591d5 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:31.743362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57e607-1779-4761-a805-176aedd591d5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:31.743362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57e607-1779-4761-a805-176aedd591d5 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:31.744649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 401/811] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:31.749983 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7717-4d50-4ef0-af40-87f0a655e976 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:31.750402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7717-4d50-4ef0-af40-87f0a655e976 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:31.750531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7717-4d50-4ef0-af40-87f0a655e976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:31.770062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e13b7717-4d50-4ef0-af40-87f0a655e976 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:31.771241 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e13b7717-4d50-4ef0-af40-87f0a655e976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:31.838713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 411/812] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:32.106444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b384143-5e11-4b66-a6ae-5bf2742ac949 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:32.106720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b384143-5e11-4b66-a6ae-5bf2742ac949 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:32.106986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b384143-5e11-4b66-a6ae-5bf2742ac949 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:32.108316 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 402/813] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:32.113371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b384143-5e11-4b66-a6ae-5bf2742ac949 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:32.113552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2692-cf33-4fd7-b492-ddbe283389e2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:32.113838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2692-cf33-4fd7-b492-ddbe283389e2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:32.114111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2692-cf33-4fd7-b492-ddbe283389e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:32.132724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f11f2692-cf33-4fd7-b492-ddbe283389e2 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:32.133931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f11f2692-cf33-4fd7-b492-ddbe283389e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:32.200181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 412/814] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:32.210723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:32.218769 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b384143-5e11-4b66-a6ae-5bf2742ac949 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:32.253507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1275ea6-5a79-43b0-932f-b57aee4303aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:32.254118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1275ea6-5a79-43b0-932f-b57aee4303aa None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:32.254393 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1275ea6-5a79-43b0-932f-b57aee4303aa None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:32.254661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1275ea6-5a79-43b0-932f-b57aee4303aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:32.264331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1275ea6-5a79-43b0-932f-b57aee4303aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-b1275ea6-5a79-43b0-932f-b57aee4303aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:15:32.269028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:32.269945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:32.270881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 403/815] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:15:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:32.276640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2692-cf33-4fd7-b492-ddbe283389e2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:32.326575 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:32.373767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2692-cf33-4fd7-b492-ddbe283389e2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:32.406184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f39383-70fb-4c93-a486-ecb8df1759c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:32.406776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f39383-70fb-4c93-a486-ecb8df1759c6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:32.407050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f39383-70fb-4c93-a486-ecb8df1759c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:32.407315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f39383-70fb-4c93-a486-ecb8df1759c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:32.407962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f39383-70fb-4c93-a486-ecb8df1759c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:32.408260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f39383-70fb-4c93-a486-ecb8df1759c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:32.409645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f39383-70fb-4c93-a486-ecb8df1759c6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:32.417981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 413/816] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:15:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:32.423684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1275ea6-5a79-43b0-932f-b57aee4303aa None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:32.481273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f39383-70fb-4c93-a486-ecb8df1759c6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:32.585072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f39383-70fb-4c93-a486-ecb8df1759c6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:32.599827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:32.621063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5af0ac-8d94-443c-af5f-cde82b297662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:32.621680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5af0ac-8d94-443c-af5f-cde82b297662 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:32.621949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5af0ac-8d94-443c-af5f-cde82b297662 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:32.622210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5af0ac-8d94-443c-af5f-cde82b297662 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:32.633640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5af0ac-8d94-443c-af5f-cde82b297662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:15:32.635340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1275ea6-5a79-43b0-932f-b57aee4303aa None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-ef5af0ac-8d94-443c-af5f-cde82b297662 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:15:32.638367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:32.639431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:32.640266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 414/817] 10.222.0.13 () {56 vars in 1120 bytes} [Wed Nov 2 07:15:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:32.645273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5af0ac-8d94-443c-af5f-cde82b297662 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:32.669399 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3049f2-2fea-40d3-a992-2f1ea246b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:32.670026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3049f2-2fea-40d3-a992-2f1ea246b98f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:32.670321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3049f2-2fea-40d3-a992-2f1ea246b98f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:32.670570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3049f2-2fea-40d3-a992-2f1ea246b98f None admin] PATH_INFO: `/v3/users/de02548439254e5fad9977bab7c5d18a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:32.683422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3049f2-2fea-40d3-a992-2f1ea246b98f None admin] RBAC: Authorizing `identity:get_user(user_id=de02548439254e5fad9977bab7c5d18a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:32.684848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3049f2-2fea-40d3-a992-2f1ea246b98f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:32.686479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 404/818] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:15:32 2022] GET /identity/v3/users/de02548439254e5fad9977bab7c5d18a => generated 285 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:32.692092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3049f2-2fea-40d3-a992-2f1ea246b98f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:32.706139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:32.744022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5af0ac-8d94-443c-af5f-cde82b297662 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:32.779219 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39a812-dd1c-41f9-8721-c21c2dd9510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:32.779824 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a812-dd1c-41f9-8721-c21c2dd9510a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:32.780070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a812-dd1c-41f9-8721-c21c2dd9510a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:32.780334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a812-dd1c-41f9-8721-c21c2dd9510a None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:32.780999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39a812-dd1c-41f9-8721-c21c2dd9510a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:32.781320 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39a812-dd1c-41f9-8721-c21c2dd9510a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:32.782670 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39a812-dd1c-41f9-8721-c21c2dd9510a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:32.790314 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3049f2-2fea-40d3-a992-2f1ea246b98f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:32.790979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 415/819] 10.222.0.13 () {56 vars in 1115 bytes} [Wed Nov 2 07:15:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:32.796710 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39a812-dd1c-41f9-8721-c21c2dd9510a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:32.823910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c427d9-ee3c-404f-b6d2-46fd84a0f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:32.824527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c427d9-ee3c-404f-b6d2-46fd84a0f004 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:32.824797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c427d9-ee3c-404f-b6d2-46fd84a0f004 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:32.825099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c427d9-ee3c-404f-b6d2-46fd84a0f004 None admin] PATH_INFO: `/v3/projects/227556edd2fc44ae808cd3bb61de926e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:32.826245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c427d9-ee3c-404f-b6d2-46fd84a0f004 None admin] RBAC: Authorizing `identity:get_project(project_id=227556edd2fc44ae808cd3bb61de926e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:32.827735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c427d9-ee3c-404f-b6d2-46fd84a0f004 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:32.829427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 405/820] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:15:32 2022] GET /identity/v3/projects/227556edd2fc44ae808cd3bb61de926e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:32.833028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:32.835534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c427d9-ee3c-404f-b6d2-46fd84a0f004 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:32.900211 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39a812-dd1c-41f9-8721-c21c2dd9510a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:32.916745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:32.935492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c427d9-ee3c-404f-b6d2-46fd84a0f004 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:32.937046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa17024-918d-4363-bd16-f024a8532b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:32.937676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa17024-918d-4363-bd16-f024a8532b6a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:32.937950 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa17024-918d-4363-bd16-f024a8532b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:32.938216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa17024-918d-4363-bd16-f024a8532b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:32.949233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa17024-918d-4363-bd16-f024a8532b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:32.950679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa17024-918d-4363-bd16-f024a8532b6a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-6fa17024-918d-4363-bd16-f024a8532b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:32.964652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:32.965674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:32.966578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:32.966578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:32.966578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:32.966578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 416/821] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:32.969058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642298ee-8d51-4bb2-940f-97281a731cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:32.969711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642298ee-8d51-4bb2-940f-97281a731cad None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:32.969981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642298ee-8d51-4bb2-940f-97281a731cad None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:32.970244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642298ee-8d51-4bb2-940f-97281a731cad None admin] PATH_INFO: `/v3/projects/227556edd2fc44ae808cd3bb61de926e/users/de02548439254e5fad9977bab7c5d18a/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:32.971702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa17024-918d-4363-bd16-f024a8532b6a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:32.972096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642298ee-8d51-4bb2-940f-97281a731cad None admin] RBAC: Authorizing `identity:create_grant(project_id=227556edd2fc44ae808cd3bb61de926e, user_id=de02548439254e5fad9977bab7c5d18a, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:32.973562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642298ee-8d51-4bb2-940f-97281a731cad None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:32.987963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 406/822] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:15:32 2022] PUT /identity/v3/projects/227556edd2fc44ae808cd3bb61de926e/users/de02548439254e5fad9977bab7c5d18a/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:15:33.070097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:33.083212 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa17024-918d-4363-bd16-f024a8532b6a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:33.119017 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffa5e9-59f3-4452-97ca-c74babc77fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:33.119633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffa5e9-59f3-4452-97ca-c74babc77fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:33.119907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffa5e9-59f3-4452-97ca-c74babc77fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:33.120176 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffa5e9-59f3-4452-97ca-c74babc77fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:33.120831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffa5e9-59f3-4452-97ca-c74babc77fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:33.121171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffa5e9-59f3-4452-97ca-c74babc77fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:33.122559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffa5e9-59f3-4452-97ca-c74babc77fa5 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:33.135376 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 417/823] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:33.141272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642298ee-8d51-4bb2-940f-97281a731cad None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:33.242395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642298ee-8d51-4bb2-940f-97281a731cad None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:33.275627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6dc39-3c56-43d1-84f0-69dfd4b292bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:33.276245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6dc39-3c56-43d1-84f0-69dfd4b292bf None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:33.276515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6dc39-3c56-43d1-84f0-69dfd4b292bf None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:33.276780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6dc39-3c56-43d1-84f0-69dfd4b292bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:33.284062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6dc39-3c56-43d1-84f0-69dfd4b292bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:33.285502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6dc39-3c56-43d1-84f0-69dfd4b292bf None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:33.287977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-00b6dc39-3c56-43d1-84f0-69dfd4b292bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:15:33.299885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:33.300851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:33.301868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 407/824] 10.222.0.13 () {56 vars in 1093 bytes} [Wed Nov 2 07:15:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:33.307007 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffa5e9-59f3-4452-97ca-c74babc77fa5 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:33.405423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffa5e9-59f3-4452-97ca-c74babc77fa5 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:33.437510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5c2fa-0217-4849-9243-72fe44593859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:33.438103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5c2fa-0217-4849-9243-72fe44593859 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:33.438371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5c2fa-0217-4849-9243-72fe44593859 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:33.438633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5c2fa-0217-4849-9243-72fe44593859 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:33.439340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5c2fa-0217-4849-9243-72fe44593859 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:33.439634 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5c2fa-0217-4849-9243-72fe44593859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:33.441049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5c2fa-0217-4849-9243-72fe44593859 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:33.458573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 418/825] 10.222.0.13 () {56 vars in 1133 bytes} [Wed Nov 2 07:15:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:33.465273 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6dc39-3c56-43d1-84f0-69dfd4b292bf None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:33.565829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6dc39-3c56-43d1-84f0-69dfd4b292bf None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:33.599557 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f2122-0d6a-4318-bc7e-d578bd6c2267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:33.600153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f2122-0d6a-4318-bc7e-d578bd6c2267 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:33.600421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f2122-0d6a-4318-bc7e-d578bd6c2267 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:33.600683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f2122-0d6a-4318-bc7e-d578bd6c2267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:33.662954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:33.665498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f2122-0d6a-4318-bc7e-d578bd6c2267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:33.667339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f2122-0d6a-4318-bc7e-d578bd6c2267 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:33.762378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 408/826] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:15:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:15:33.768161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5c2fa-0217-4849-9243-72fe44593859 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:33.777556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:33.868324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5c2fa-0217-4849-9243-72fe44593859 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:33.901437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aacaf-82d0-4ec1-ad77-dc576566ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:33.902061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aacaf-82d0-4ec1-ad77-dc576566ed55 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:33.902335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aacaf-82d0-4ec1-ad77-dc576566ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:33.902599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aacaf-82d0-4ec1-ad77-dc576566ed55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:33.915269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2aacaf-82d0-4ec1-ad77-dc576566ed55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:33.916694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2aacaf-82d0-4ec1-ad77-dc576566ed55 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-5e2aacaf-82d0-4ec1-ad77-dc576566ed55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:15:33.930866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:33.936454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:15:33.937486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:15:33.937486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:15:33.937486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:33.937486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 419/827] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:33.937731 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f2122-0d6a-4318-bc7e-d578bd6c2267 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:34.029296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:34.032419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f2122-0d6a-4318-bc7e-d578bd6c2267 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:34.064935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319fcf-8c38-4fe1-83ab-15a2d4ebb251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:34.065554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319fcf-8c38-4fe1-83ab-15a2d4ebb251 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:34.065824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319fcf-8c38-4fe1-83ab-15a2d4ebb251 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:34.066085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319fcf-8c38-4fe1-83ab-15a2d4ebb251 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:34.066712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319fcf-8c38-4fe1-83ab-15a2d4ebb251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:34.067005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319fcf-8c38-4fe1-83ab-15a2d4ebb251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:34.068331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319fcf-8c38-4fe1-83ab-15a2d4ebb251 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:34.079026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 409/828] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:34.084587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aacaf-82d0-4ec1-ad77-dc576566ed55 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:34.141460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:34.183034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aacaf-82d0-4ec1-ad77-dc576566ed55 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:34.216482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ed6eb-96d0-42b4-be41-f3dd19476ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:34.217130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ed6eb-96d0-42b4-be41-f3dd19476ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:34.217404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ed6eb-96d0-42b4-be41-f3dd19476ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:34.217666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ed6eb-96d0-42b4-be41-f3dd19476ef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:34.224246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ed6eb-96d0-42b4-be41-f3dd19476ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:34.225702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ed6eb-96d0-42b4-be41-f3dd19476ef9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-404ed6eb-96d0-42b4-be41-f3dd19476ef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:15:34.237138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:34.238024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:34.239101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:15:34.239101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:15:34.239101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:15:34.239101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:15:34.239101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:15:34.239101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:15:34.239101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:15:34.239101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:34.239101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 420/829] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:15:34.244626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319fcf-8c38-4fe1-83ab-15a2d4ebb251 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:34.341413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319fcf-8c38-4fe1-83ab-15a2d4ebb251 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:34.374536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898e610-4a30-40d5-81a2-675c3b0b37bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:34.375130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e610-4a30-40d5-81a2-675c3b0b37bb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:34.375401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e610-4a30-40d5-81a2-675c3b0b37bb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:34.375664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e610-4a30-40d5-81a2-675c3b0b37bb None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:34.376331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e610-4a30-40d5-81a2-675c3b0b37bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:34.376627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e610-4a30-40d5-81a2-675c3b0b37bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:34.378071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e610-4a30-40d5-81a2-675c3b0b37bb None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:34.389695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 410/830] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:34.395677 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ed6eb-96d0-42b4-be41-f3dd19476ef9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:34.491445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ed6eb-96d0-42b4-be41-f3dd19476ef9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:34.508466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:34.525372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea43ef2-f9c4-437d-97bc-8c3240ec5f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:34.525961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43ef2-f9c4-437d-97bc-8c3240ec5f70 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:34.526232 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43ef2-f9c4-437d-97bc-8c3240ec5f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:34.526496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea43ef2-f9c4-437d-97bc-8c3240ec5f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:34.527199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea43ef2-f9c4-437d-97bc-8c3240ec5f70 None admin] RBAC: Adding query filter params (role.id=23eea1dba0c84318a532485385fd19b2, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=ad0826bb58db4100b0d807fb07734deb) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:34.527499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea43ef2-f9c4-437d-97bc-8c3240ec5f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:34.528898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea43ef2-f9c4-437d-97bc-8c3240ec5f70 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:34.534572 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 421/831] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:15:34 2022] GET /identity/v3/role_assignments?user.id=ad0826bb58db4100b0d807fb07734deb&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=23eea1dba0c84318a532485385fd19b2 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:35.133582 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9b4c9-9338-402c-8bc5-b5d70389db5b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:35.134090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9b4c9-9338-402c-8bc5-b5d70389db5b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:35.134177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9b4c9-9338-402c-8bc5-b5d70389db5b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:35.135453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 411/832] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:35.140902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662615-5d9a-4ea5-97c4-748fdeeb0b38 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:35.141365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662615-5d9a-4ea5-97c4-748fdeeb0b38 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:35.141457 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662615-5d9a-4ea5-97c4-748fdeeb0b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:35.160018 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8b662615-5d9a-4ea5-97c4-748fdeeb0b38 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:35.161244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8b662615-5d9a-4ea5-97c4-748fdeeb0b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:35.233595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 422/833] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:35.497849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9b4c9-9338-402c-8bc5-b5d70389db5b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:35.519324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:35.595998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9b4c9-9338-402c-8bc5-b5d70389db5b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:35.628399 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc64e81-432b-41ff-aa80-4e19f10119eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:35.629033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc64e81-432b-41ff-aa80-4e19f10119eb None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:35.629308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc64e81-432b-41ff-aa80-4e19f10119eb None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:35.629575 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc64e81-432b-41ff-aa80-4e19f10119eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:35.639870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc64e81-432b-41ff-aa80-4e19f10119eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-4bc64e81-432b-41ff-aa80-4e19f10119eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:15:35.644554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:35.645654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:35.646698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 412/834] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:35.652251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b662615-5d9a-4ea5-97c4-748fdeeb0b38 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:35.746856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b662615-5d9a-4ea5-97c4-748fdeeb0b38 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:35.760586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:35.781598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472fbcf-8230-406a-af4e-a101f8d619d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:35.782189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472fbcf-8230-406a-af4e-a101f8d619d6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:35.782460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472fbcf-8230-406a-af4e-a101f8d619d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:35.782726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472fbcf-8230-406a-af4e-a101f8d619d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:35.783373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472fbcf-8230-406a-af4e-a101f8d619d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:35.783671 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472fbcf-8230-406a-af4e-a101f8d619d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:35.785032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472fbcf-8230-406a-af4e-a101f8d619d6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:35.792808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 423/835] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:35.798637 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc64e81-432b-41ff-aa80-4e19f10119eb None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:35.877336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:35.896492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc64e81-432b-41ff-aa80-4e19f10119eb None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:35.928571 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1b528-fbc7-4496-aafc-e293f6bbaed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:35.929214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b528-fbc7-4496-aafc-e293f6bbaed3 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:35.930034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b528-fbc7-4496-aafc-e293f6bbaed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:35.930297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1b528-fbc7-4496-aafc-e293f6bbaed3 None admin] PATH_INFO: `/v3/users/de02548439254e5fad9977bab7c5d18a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:35.931388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1b528-fbc7-4496-aafc-e293f6bbaed3 None admin] RBAC: Authorizing `identity:get_user(user_id=de02548439254e5fad9977bab7c5d18a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:35.932787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1b528-fbc7-4496-aafc-e293f6bbaed3 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:35.934361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 413/836] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:15:35 2022] GET /identity/v3/users/de02548439254e5fad9977bab7c5d18a => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:35.940020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472fbcf-8230-406a-af4e-a101f8d619d6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:36.036390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472fbcf-8230-406a-af4e-a101f8d619d6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:36.068382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad658835-59a1-4115-b149-4bad0f50aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:36.068967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad658835-59a1-4115-b149-4bad0f50aac1 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:36.069272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad658835-59a1-4115-b149-4bad0f50aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:36.069541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad658835-59a1-4115-b149-4bad0f50aac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:36.110709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:36.134742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad658835-59a1-4115-b149-4bad0f50aac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:36.136174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad658835-59a1-4115-b149-4bad0f50aac1 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:36.232101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 424/837] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:15:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:15:36.237890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1b528-fbc7-4496-aafc-e293f6bbaed3 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:36.331613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1b528-fbc7-4496-aafc-e293f6bbaed3 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:36.364105 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d7712-9d08-4418-a2b4-948964a3a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:36.364707 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7712-9d08-4418-a2b4-948964a3a64d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:36.364977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7712-9d08-4418-a2b4-948964a3a64d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:36.365274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7712-9d08-4418-a2b4-948964a3a64d None admin] PATH_INFO: `/v3/projects/227556edd2fc44ae808cd3bb61de926e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:36.366354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d7712-9d08-4418-a2b4-948964a3a64d None admin] RBAC: Authorizing `identity:get_project(project_id=227556edd2fc44ae808cd3bb61de926e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:36.368019 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d7712-9d08-4418-a2b4-948964a3a64d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:36.369606 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 414/838] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:15:36 2022] GET /identity/v3/projects/227556edd2fc44ae808cd3bb61de926e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:36.375464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad658835-59a1-4115-b149-4bad0f50aac1 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:36.447011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:36.471789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad658835-59a1-4115-b149-4bad0f50aac1 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:36.505214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1997df-e426-4ce5-a310-de08f5e2cc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:36.505791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1997df-e426-4ce5-a310-de08f5e2cc8d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:36.506061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1997df-e426-4ce5-a310-de08f5e2cc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:36.506326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1997df-e426-4ce5-a310-de08f5e2cc8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:36.507033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1997df-e426-4ce5-a310-de08f5e2cc8d None admin] RBAC: Adding query filter params (role.id=6a01757540e64fed9041997458bd64e5, scope.project.id=227556edd2fc44ae808cd3bb61de926e, user.id=de02548439254e5fad9977bab7c5d18a) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:36.507333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1997df-e426-4ce5-a310-de08f5e2cc8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:36.508764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1997df-e426-4ce5-a310-de08f5e2cc8d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:36.514288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 425/839] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:15:36 2022] GET /identity/v3/role_assignments?user.id=de02548439254e5fad9977bab7c5d18a&scope.project.id=227556edd2fc44ae808cd3bb61de926e&role.id=6a01757540e64fed9041997458bd64e5 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:38.659313 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9547a1f-4c0a-4b25-be47-9c80be4e58f7 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:38.659841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9547a1f-4c0a-4b25-be47-9c80be4e58f7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:38.659841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9547a1f-4c0a-4b25-be47-9c80be4e58f7 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:38.661199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 415/840] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:38.667114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a09ea-fb5b-47de-8082-99137c27cb1d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:38.667554 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a09ea-fb5b-47de-8082-99137c27cb1d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:38.667662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a09ea-fb5b-47de-8082-99137c27cb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:38.686104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-903a09ea-fb5b-47de-8082-99137c27cb1d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:38.687293 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-903a09ea-fb5b-47de-8082-99137c27cb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:38.750619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 426/841] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:39.025583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9547a1f-4c0a-4b25-be47-9c80be4e58f7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:39.044316 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:39.124523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9547a1f-4c0a-4b25-be47-9c80be4e58f7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:39.156613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b1844-84e2-4ed5-8dba-33676a19ef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:39.157244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b1844-84e2-4ed5-8dba-33676a19ef94 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:39.157517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b1844-84e2-4ed5-8dba-33676a19ef94 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:39.157782 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b1844-84e2-4ed5-8dba-33676a19ef94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:39.158860 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b1844-84e2-4ed5-8dba-33676a19ef94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:39.160255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b1844-84e2-4ed5-8dba-33676a19ef94 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:39.161795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 416/842] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:39.168121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a09ea-fb5b-47de-8082-99137c27cb1d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:39.233391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:39.265811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a09ea-fb5b-47de-8082-99137c27cb1d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:39.298156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c311899-bb5d-480c-aa86-32519d45927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:39.298750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c311899-bb5d-480c-aa86-32519d45927a None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:39.299024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c311899-bb5d-480c-aa86-32519d45927a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:39.299292 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c311899-bb5d-480c-aa86-32519d45927a None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:39.299926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c311899-bb5d-480c-aa86-32519d45927a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:39.301358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c311899-bb5d-480c-aa86-32519d45927a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:39.323375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 427/843] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:15:39 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:41.461540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce361a-511a-4fa9-b1ee-057c23dcf1ce None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:41.462072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce361a-511a-4fa9-b1ee-057c23dcf1ce None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:41.462072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce361a-511a-4fa9-b1ee-057c23dcf1ce None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:41.463383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 417/844] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:41.468893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe694-c94c-4e15-a70f-bf900e3fdb3c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:41.469343 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe694-c94c-4e15-a70f-bf900e3fdb3c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:41.469462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe694-c94c-4e15-a70f-bf900e3fdb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:41.487741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a93fe694-c94c-4e15-a70f-bf900e3fdb3c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:41.488909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a93fe694-c94c-4e15-a70f-bf900e3fdb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:41.553552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 428/845] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:41.822051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce361a-511a-4fa9-b1ee-057c23dcf1ce None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:41.903861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:41.921147 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce361a-511a-4fa9-b1ee-057c23dcf1ce None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:41.953346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade82f-b4f9-4986-b9b7-a67f76a2ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:41.953958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade82f-b4f9-4986-b9b7-a67f76a2ed60 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:41.954230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade82f-b4f9-4986-b9b7-a67f76a2ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:41.954492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade82f-b4f9-4986-b9b7-a67f76a2ed60 None admin] PATH_INFO: `/v3/roles/2ba82c8be98e49f3a4e424556cab4bd3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:41.955840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade82f-b4f9-4986-b9b7-a67f76a2ed60 None admin] RBAC: Authorizing `identity:get_role(role_id=2ba82c8be98e49f3a4e424556cab4bd3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:41.957208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade82f-b4f9-4986-b9b7-a67f76a2ed60 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:41.958495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 418/846] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:15:41 2022] GET /identity/v3/roles/2ba82c8be98e49f3a4e424556cab4bd3 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:41.964453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fe694-c94c-4e15-a70f-bf900e3fdb3c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:42.017587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:42.060688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fe694-c94c-4e15-a70f-bf900e3fdb3c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:42.093082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75300f-55a0-475d-966f-72e96b4f6402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:42.093894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75300f-55a0-475d-966f-72e96b4f6402 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:42.094166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75300f-55a0-475d-966f-72e96b4f6402 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:42.094441 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75300f-55a0-475d-966f-72e96b4f6402 None admin] PATH_INFO: `/v3/users/a86c6e6c3c044b4db0d5a0d7e70dede0` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:42.106919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75300f-55a0-475d-966f-72e96b4f6402 None admin] RBAC: Authorizing `identity:get_user(user_id=a86c6e6c3c044b4db0d5a0d7e70dede0)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:42.108335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75300f-55a0-475d-966f-72e96b4f6402 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:42.109909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 429/847] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:15:41 2022] GET /identity/v3/users/a86c6e6c3c044b4db0d5a0d7e70dede0 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:42.115629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade82f-b4f9-4986-b9b7-a67f76a2ed60 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:42.211891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade82f-b4f9-4986-b9b7-a67f76a2ed60 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:42.244095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cd0e3-29e6-4ad2-ada5-0f4a2947ec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:42.244695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd0e3-29e6-4ad2-ada5-0f4a2947ec9d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:42.244964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd0e3-29e6-4ad2-ada5-0f4a2947ec9d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:42.245261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd0e3-29e6-4ad2-ada5-0f4a2947ec9d None admin] PATH_INFO: `/v3/projects/227556edd2fc44ae808cd3bb61de926e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:42.246339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cd0e3-29e6-4ad2-ada5-0f4a2947ec9d None admin] RBAC: Authorizing `identity:get_project(project_id=227556edd2fc44ae808cd3bb61de926e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:42.247736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cd0e3-29e6-4ad2-ada5-0f4a2947ec9d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:42.249335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 419/848] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:15:42 2022] GET /identity/v3/projects/227556edd2fc44ae808cd3bb61de926e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:42.255035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75300f-55a0-475d-966f-72e96b4f6402 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:42.352019 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75300f-55a0-475d-966f-72e96b4f6402 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:42.364285 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:42.385347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93249bc7-3174-40bc-b2bf-a91dfc7d0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:42.385981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249bc7-3174-40bc-b2bf-a91dfc7d0594 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:42.386251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249bc7-3174-40bc-b2bf-a91dfc7d0594 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:42.386514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249bc7-3174-40bc-b2bf-a91dfc7d0594 None admin] PATH_INFO: `/v3/projects/227556edd2fc44ae808cd3bb61de926e/users/a86c6e6c3c044b4db0d5a0d7e70dede0/roles/2ba82c8be98e49f3a4e424556cab4bd3` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:42.388587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93249bc7-3174-40bc-b2bf-a91dfc7d0594 None admin] RBAC: Authorizing `identity:create_grant(project_id=227556edd2fc44ae808cd3bb61de926e, user_id=a86c6e6c3c044b4db0d5a0d7e70dede0, role_id=2ba82c8be98e49f3a4e424556cab4bd3)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:42.390010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93249bc7-3174-40bc-b2bf-a91dfc7d0594 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:42.402446 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 430/849] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:15:42 2022] PUT /identity/v3/projects/227556edd2fc44ae808cd3bb61de926e/users/a86c6e6c3c044b4db0d5a0d7e70dede0/roles/2ba82c8be98e49f3a4e424556cab4bd3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:15:44.497291 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b0ca3-2c00-494f-9e18-a0e53684d7b3 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:44.497814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b0ca3-2c00-494f-9e18-a0e53684d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:44.497814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b0ca3-2c00-494f-9e18-a0e53684d7b3 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:44.499178 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 420/850] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:44.504498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7a086-d46b-41f8-9435-e0b9a9ee5f01 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:44.504872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7a086-d46b-41f8-9435-e0b9a9ee5f01 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:44.505063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7a086-d46b-41f8-9435-e0b9a9ee5f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:44.523605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4cf7a086-d46b-41f8-9435-e0b9a9ee5f01 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:44.524764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4cf7a086-d46b-41f8-9435-e0b9a9ee5f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:44.591080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 431/851] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:44.860233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b0ca3-2c00-494f-9e18-a0e53684d7b3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:44.882116 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:44.961714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b0ca3-2c00-494f-9e18-a0e53684d7b3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:44.994476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869f33-a0fd-41f4-ab4b-c5f9ed8da8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:44.995087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869f33-a0fd-41f4-ab4b-c5f9ed8da8fa None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:44.995361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869f33-a0fd-41f4-ab4b-c5f9ed8da8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:44.995626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869f33-a0fd-41f4-ab4b-c5f9ed8da8fa None admin] PATH_INFO: `/v3/roles/2ba82c8be98e49f3a4e424556cab4bd3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:44.996986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869f33-a0fd-41f4-ab4b-c5f9ed8da8fa None admin] RBAC: Authorizing `identity:get_role(role_id=2ba82c8be98e49f3a4e424556cab4bd3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:44.998366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a869f33-a0fd-41f4-ab4b-c5f9ed8da8fa None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:44.999658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 421/852] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:15:44 2022] GET /identity/v3/roles/2ba82c8be98e49f3a4e424556cab4bd3 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:45.005490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7a086-d46b-41f8-9435-e0b9a9ee5f01 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:45.099610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7a086-d46b-41f8-9435-e0b9a9ee5f01 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:45.101334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:45.135442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223c42a-4ef5-4c72-a94d-45f181744ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:45.135990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223c42a-4ef5-4c72-a94d-45f181744ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:45.136262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223c42a-4ef5-4c72-a94d-45f181744ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:45.136529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223c42a-4ef5-4c72-a94d-45f181744ed7 None admin] PATH_INFO: `/v3/users/a86c6e6c3c044b4db0d5a0d7e70dede0` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:45.137640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223c42a-4ef5-4c72-a94d-45f181744ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=a86c6e6c3c044b4db0d5a0d7e70dede0)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:45.139057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223c42a-4ef5-4c72-a94d-45f181744ed7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:45.140596 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 432/853] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:15:45 2022] GET /identity/v3/users/a86c6e6c3c044b4db0d5a0d7e70dede0 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:45.146448 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869f33-a0fd-41f4-ab4b-c5f9ed8da8fa None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:45.231084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:45.243457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869f33-a0fd-41f4-ab4b-c5f9ed8da8fa None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:45.275884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e93e8-a727-4832-8a7c-1c07226d61c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:45.276472 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e93e8-a727-4832-8a7c-1c07226d61c2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:45.276745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e93e8-a727-4832-8a7c-1c07226d61c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:45.277037 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e93e8-a727-4832-8a7c-1c07226d61c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:45.340550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e93e8-a727-4832-8a7c-1c07226d61c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:45.341990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e93e8-a727-4832-8a7c-1c07226d61c2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:45.424367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:45.437428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 422/854] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:15:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:15:45.443415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223c42a-4ef5-4c72-a94d-45f181744ed7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:45.539731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223c42a-4ef5-4c72-a94d-45f181744ed7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:45.572348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eba5d-4d82-4a98-b1f6-86ed57d1acb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:45.572954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eba5d-4d82-4a98-b1f6-86ed57d1acb9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:45.573255 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eba5d-4d82-4a98-b1f6-86ed57d1acb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:45.573523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eba5d-4d82-4a98-b1f6-86ed57d1acb9 None admin] PATH_INFO: `/v3/projects/227556edd2fc44ae808cd3bb61de926e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:45.574612 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22eba5d-4d82-4a98-b1f6-86ed57d1acb9 None admin] RBAC: Authorizing `identity:get_project(project_id=227556edd2fc44ae808cd3bb61de926e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:45.576018 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22eba5d-4d82-4a98-b1f6-86ed57d1acb9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:45.577635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 433/855] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:15:45 2022] GET /identity/v3/projects/227556edd2fc44ae808cd3bb61de926e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:45.583912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e93e8-a727-4832-8a7c-1c07226d61c2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:45.678826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e93e8-a727-4832-8a7c-1c07226d61c2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:45.712170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287c9b9-9107-4e61-8a56-0cb6be661eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:45.712749 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287c9b9-9107-4e61-8a56-0cb6be661eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:45.713039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287c9b9-9107-4e61-8a56-0cb6be661eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:45.713326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287c9b9-9107-4e61-8a56-0cb6be661eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:45.714030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287c9b9-9107-4e61-8a56-0cb6be661eb5 None admin] RBAC: Adding query filter params (role.id=2ba82c8be98e49f3a4e424556cab4bd3, scope.project.id=227556edd2fc44ae808cd3bb61de926e, user.id=a86c6e6c3c044b4db0d5a0d7e70dede0) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:45.714329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287c9b9-9107-4e61-8a56-0cb6be661eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:45.715719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287c9b9-9107-4e61-8a56-0cb6be661eb5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:45.721516 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 423/856] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:15:45 2022] GET /identity/v3/role_assignments?user.id=a86c6e6c3c044b4db0d5a0d7e70dede0&scope.project.id=227556edd2fc44ae808cd3bb61de926e&role.id=2ba82c8be98e49f3a4e424556cab4bd3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:47.845108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1aa0-4bdb-484c-8371-a5e35135ffbb None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:47.845644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1aa0-4bdb-484c-8371-a5e35135ffbb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:47.845644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1aa0-4bdb-484c-8371-a5e35135ffbb None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:47.846953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 434/857] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:47.852661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a61f1f-bee2-4644-86c4-02ee19b4dde5 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:47.853061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a61f1f-bee2-4644-86c4-02ee19b4dde5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:47.853240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a61f1f-bee2-4644-86c4-02ee19b4dde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:47.871533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a6a61f1f-bee2-4644-86c4-02ee19b4dde5 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:47.872717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a6a61f1f-bee2-4644-86c4-02ee19b4dde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:47.918210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:47.938101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 424/858] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:48.201917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f1aa0-4bdb-484c-8371-a5e35135ffbb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:48.241071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:48.299464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f1aa0-4bdb-484c-8371-a5e35135ffbb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:48.332442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ddcd-0fa4-4c82-9ae1-5fa32c7e9908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:48.333069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ddcd-0fa4-4c82-9ae1-5fa32c7e9908 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:48.333346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ddcd-0fa4-4c82-9ae1-5fa32c7e9908 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:48.333614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ddcd-0fa4-4c82-9ae1-5fa32c7e9908 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:48.334702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2ddcd-0fa4-4c82-9ae1-5fa32c7e9908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:48.336180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2ddcd-0fa4-4c82-9ae1-5fa32c7e9908 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:48.337729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 435/859] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:48.343449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a61f1f-bee2-4644-86c4-02ee19b4dde5 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:48.439377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a61f1f-bee2-4644-86c4-02ee19b4dde5 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:48.472950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e284130-52a6-4bf1-b5e7-c6eabc9d3536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:48.473503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e284130-52a6-4bf1-b5e7-c6eabc9d3536 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:48.473773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e284130-52a6-4bf1-b5e7-c6eabc9d3536 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:48.474036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e284130-52a6-4bf1-b5e7-c6eabc9d3536 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:48.474689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e284130-52a6-4bf1-b5e7-c6eabc9d3536 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:48.476122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e284130-52a6-4bf1-b5e7-c6eabc9d3536 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:48.501915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 425/860] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:15:48 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:50.655589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721235f-92e8-49a1-a685-67171d96cebc None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:50.656190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721235f-92e8-49a1-a685-67171d96cebc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:50.656190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721235f-92e8-49a1-a685-67171d96cebc None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:50.657488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 436/861] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:50.662623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ba740-62c3-4703-8105-8ed745558cb3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:50.662990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ba740-62c3-4703-8105-8ed745558cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:50.663160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ba740-62c3-4703-8105-8ed745558cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:50.681061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7a6ba740-62c3-4703-8105-8ed745558cb3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:50.682217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7a6ba740-62c3-4703-8105-8ed745558cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:50.709669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:50.751076 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 426/862] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:51.021184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721235f-92e8-49a1-a685-67171d96cebc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:51.120107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721235f-92e8-49a1-a685-67171d96cebc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:51.127056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:51.152851 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9b281-5256-4b6a-9db2-0c226e775400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:51.153489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9b281-5256-4b6a-9db2-0c226e775400 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:51.153762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9b281-5256-4b6a-9db2-0c226e775400 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:51.154030 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9b281-5256-4b6a-9db2-0c226e775400 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:51.155113 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9b281-5256-4b6a-9db2-0c226e775400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:51.156520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9b281-5256-4b6a-9db2-0c226e775400 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:51.158084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 437/863] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:15:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:51.163873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ba740-62c3-4703-8105-8ed745558cb3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:51.260253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ba740-62c3-4703-8105-8ed745558cb3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:51.292495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c90bd3-d64e-4d27-b71b-5d5436c3e814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:51.293105 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c90bd3-d64e-4d27-b71b-5d5436c3e814 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:51.293383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c90bd3-d64e-4d27-b71b-5d5436c3e814 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:51.293651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c90bd3-d64e-4d27-b71b-5d5436c3e814 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:51.294281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c90bd3-d64e-4d27-b71b-5d5436c3e814 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:51.295685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c90bd3-d64e-4d27-b71b-5d5436c3e814 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:51.316244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 427/864] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:15:51 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:15:53.559451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22115a6-5e31-49b3-855e-9cc2ecbeb412 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:53.559982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22115a6-5e31-49b3-855e-9cc2ecbeb412 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:53.559982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22115a6-5e31-49b3-855e-9cc2ecbeb412 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:53.563758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 438/865] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:53.573418 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4faf4-0a86-45a4-8cee-71281e652c9a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:53.573892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4faf4-0a86-45a4-8cee-71281e652c9a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:53.573986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4faf4-0a86-45a4-8cee-71281e652c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:53.593369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-fbc4faf4-0a86-45a4-8cee-71281e652c9a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:53.595428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fbc4faf4-0a86-45a4-8cee-71281e652c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:53.613226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:53.671402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 428/866] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:53.950938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22115a6-5e31-49b3-855e-9cc2ecbeb412 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:54.050520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22115a6-5e31-49b3-855e-9cc2ecbeb412 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:54.198725 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e5dfe-d632-492c-a0da-404e12826836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:54.199253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5dfe-d632-492c-a0da-404e12826836 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:54.199530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5dfe-d632-492c-a0da-404e12826836 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:54.199800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5dfe-d632-492c-a0da-404e12826836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:54.209696 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e5dfe-d632-492c-a0da-404e12826836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-082e5dfe-d632-492c-a0da-404e12826836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:15:54.214728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:54.215645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:15:54.216557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 439/867] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:54.222161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4faf4-0a86-45a4-8cee-71281e652c9a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:54.316841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4faf4-0a86-45a4-8cee-71281e652c9a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:54.349487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5a7f-6681-4d4b-88ac-ea63ecf758a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:54.350072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5a7f-6681-4d4b-88ac-ea63ecf758a6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:54.350340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5a7f-6681-4d4b-88ac-ea63ecf758a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:54.350604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5a7f-6681-4d4b-88ac-ea63ecf758a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:54.351770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5a7f-6681-4d4b-88ac-ea63ecf758a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:54.352120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5a7f-6681-4d4b-88ac-ea63ecf758a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:54.353531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5a7f-6681-4d4b-88ac-ea63ecf758a6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:54.361395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 429/868] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:54.367369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e5dfe-d632-492c-a0da-404e12826836 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:54.401215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:54.464542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e5dfe-d632-492c-a0da-404e12826836 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:54.497920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8959f9-c3b3-4f4c-81bd-b8718c71ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:54.498533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8959f9-c3b3-4f4c-81bd-b8718c71ef37 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:54.498807 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8959f9-c3b3-4f4c-81bd-b8718c71ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:54.499075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8959f9-c3b3-4f4c-81bd-b8718c71ef37 None admin] PATH_INFO: `/v3/users/747e2a175d304ac4b31436ace4a46a21` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:54.511544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8959f9-c3b3-4f4c-81bd-b8718c71ef37 None admin] RBAC: Authorizing `identity:get_user(user_id=747e2a175d304ac4b31436ace4a46a21)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:54.512953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8959f9-c3b3-4f4c-81bd-b8718c71ef37 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:54.514581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 440/869] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:15:54 2022] GET /identity/v3/users/747e2a175d304ac4b31436ace4a46a21 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:54.520199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5a7f-6681-4d4b-88ac-ea63ecf758a6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:54.534889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:54.616242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5a7f-6681-4d4b-88ac-ea63ecf758a6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:54.647981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b968a8a-7a28-4089-a539-18a331e61c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:54.648592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968a8a-7a28-4089-a539-18a331e61c2c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:54.648859 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968a8a-7a28-4089-a539-18a331e61c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:54.649154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b968a8a-7a28-4089-a539-18a331e61c2c None admin] PATH_INFO: `/v3/projects/524721b99acb46a0bde5e46044fdf76d` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:54.650242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b968a8a-7a28-4089-a539-18a331e61c2c None admin] RBAC: Authorizing `identity:get_project(project_id=524721b99acb46a0bde5e46044fdf76d)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:54.651655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b968a8a-7a28-4089-a539-18a331e61c2c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:54.653260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 430/870] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:15:54 2022] GET /identity/v3/projects/524721b99acb46a0bde5e46044fdf76d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:54.659218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8959f9-c3b3-4f4c-81bd-b8718c71ef37 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:54.747972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:54.756774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8959f9-c3b3-4f4c-81bd-b8718c71ef37 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:54.789689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fc05f-c8e5-4f17-8caf-170623f83739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:54.790323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fc05f-c8e5-4f17-8caf-170623f83739 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:54.790594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fc05f-c8e5-4f17-8caf-170623f83739 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:54.790865 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fc05f-c8e5-4f17-8caf-170623f83739 None admin] PATH_INFO: `/v3/projects/524721b99acb46a0bde5e46044fdf76d/users/747e2a175d304ac4b31436ace4a46a21/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:54.792713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fc05f-c8e5-4f17-8caf-170623f83739 None admin] RBAC: Authorizing `identity:create_grant(project_id=524721b99acb46a0bde5e46044fdf76d, user_id=747e2a175d304ac4b31436ace4a46a21, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:54.794143 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fc05f-c8e5-4f17-8caf-170623f83739 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:54.806658 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 441/871] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:15:54 2022] PUT /identity/v3/projects/524721b99acb46a0bde5e46044fdf76d/users/747e2a175d304ac4b31436ace4a46a21/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:15:56.928700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7eec-3b09-4bd6-b07d-f28317207e61 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:56.929118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7eec-3b09-4bd6-b07d-f28317207e61 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:56.929851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7eec-3b09-4bd6-b07d-f28317207e61 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:56.931280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 431/872] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:15:56.936520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb29b0-f95a-45fb-9e76-07d0e759e21e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:56.936882 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb29b0-f95a-45fb-9e76-07d0e759e21e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:56.937089 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb29b0-f95a-45fb-9e76-07d0e759e21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:56.954738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3efb29b0-f95a-45fb-9e76-07d0e759e21e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:15:56.955913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3efb29b0-f95a-45fb-9e76-07d0e759e21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:15:57.019822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 442/873] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:15:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:15:57.291928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b7eec-3b09-4bd6-b07d-f28317207e61 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:57.370952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:57.390742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b7eec-3b09-4bd6-b07d-f28317207e61 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:57.422644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72c554-cf4e-4cd2-aee1-b56fbd1baa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:57.423252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72c554-cf4e-4cd2-aee1-b56fbd1baa40 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:57.423526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72c554-cf4e-4cd2-aee1-b56fbd1baa40 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:57.423794 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72c554-cf4e-4cd2-aee1-b56fbd1baa40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:57.434412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72c554-cf4e-4cd2-aee1-b56fbd1baa40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1c72c554-cf4e-4cd2-aee1-b56fbd1baa40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:15:57.439106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:15:57.440179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:15:57.441063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 432/874] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:15:57.446418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb29b0-f95a-45fb-9e76-07d0e759e21e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:57.525744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:57.544164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb29b0-f95a-45fb-9e76-07d0e759e21e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:57.577379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18600f3-32d8-4008-af5c-ff8088853afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:57.577958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18600f3-32d8-4008-af5c-ff8088853afb None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:57.578227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18600f3-32d8-4008-af5c-ff8088853afb None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:57.578492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18600f3-32d8-4008-af5c-ff8088853afb None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:57.579131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18600f3-32d8-4008-af5c-ff8088853afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:57.579422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18600f3-32d8-4008-af5c-ff8088853afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:57.580757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18600f3-32d8-4008-af5c-ff8088853afb None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:57.588934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 443/875] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:57.595234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72c554-cf4e-4cd2-aee1-b56fbd1baa40 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:57.690703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72c554-cf4e-4cd2-aee1-b56fbd1baa40 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:57.723884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0fc99-24dd-4409-8094-5b8a8ccc864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:57.724483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0fc99-24dd-4409-8094-5b8a8ccc864a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:57.724755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0fc99-24dd-4409-8094-5b8a8ccc864a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:57.725041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0fc99-24dd-4409-8094-5b8a8ccc864a None admin] PATH_INFO: `/v3/users/747e2a175d304ac4b31436ace4a46a21` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:57.726658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0fc99-24dd-4409-8094-5b8a8ccc864a None admin] RBAC: Authorizing `identity:get_user(user_id=747e2a175d304ac4b31436ace4a46a21)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:57.728199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0fc99-24dd-4409-8094-5b8a8ccc864a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:57.729744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 433/876] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:15:57 2022] GET /identity/v3/users/747e2a175d304ac4b31436ace4a46a21 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:15:57.735596 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18600f3-32d8-4008-af5c-ff8088853afb None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:57.833406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18600f3-32d8-4008-af5c-ff8088853afb None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:57.866485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f4d2e-0b95-4cde-a32e-790c20611986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:57.867704 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f4d2e-0b95-4cde-a32e-790c20611986 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:57.868035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f4d2e-0b95-4cde-a32e-790c20611986 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:57.868302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f4d2e-0b95-4cde-a32e-790c20611986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:57.881872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:57.934633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f4d2e-0b95-4cde-a32e-790c20611986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:57.936064 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f4d2e-0b95-4cde-a32e-790c20611986 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:58.030010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 444/877] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:15:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:15:58.035971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0fc99-24dd-4409-8094-5b8a8ccc864a None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:58.046902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:58.132807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0fc99-24dd-4409-8094-5b8a8ccc864a None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:58.164427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11ab1f-aebf-40cb-94b1-6e2717d2d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:58.165047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ab1f-aebf-40cb-94b1-6e2717d2d72d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:58.165327 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ab1f-aebf-40cb-94b1-6e2717d2d72d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:58.165590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ab1f-aebf-40cb-94b1-6e2717d2d72d None admin] PATH_INFO: `/v3/projects/524721b99acb46a0bde5e46044fdf76d` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:58.166673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11ab1f-aebf-40cb-94b1-6e2717d2d72d None admin] RBAC: Authorizing `identity:get_project(project_id=524721b99acb46a0bde5e46044fdf76d)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:58.168070 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11ab1f-aebf-40cb-94b1-6e2717d2d72d None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:58.169848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 434/878] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:15:58 2022] GET /identity/v3/projects/524721b99acb46a0bde5e46044fdf76d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:15:58.175927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f4d2e-0b95-4cde-a32e-790c20611986 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:15:58.219728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:15:58.270918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f4d2e-0b95-4cde-a32e-790c20611986 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:15:58.303036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8648c1b-0f9c-435d-801b-4840a5304289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:15:58.303603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8648c1b-0f9c-435d-801b-4840a5304289 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:15:58.303870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8648c1b-0f9c-435d-801b-4840a5304289 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:15:58.304195 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8648c1b-0f9c-435d-801b-4840a5304289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:15:58.304900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8648c1b-0f9c-435d-801b-4840a5304289 None admin] RBAC: Adding query filter params (role.id=6a01757540e64fed9041997458bd64e5, scope.project.id=524721b99acb46a0bde5e46044fdf76d, user.id=747e2a175d304ac4b31436ace4a46a21) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:15:58.305386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8648c1b-0f9c-435d-801b-4840a5304289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:15:58.306779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8648c1b-0f9c-435d-801b-4840a5304289 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:15:58.312247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 445/879] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:15:58 2022] GET /identity/v3/role_assignments?user.id=747e2a175d304ac4b31436ace4a46a21&scope.project.id=524721b99acb46a0bde5e46044fdf76d&role.id=6a01757540e64fed9041997458bd64e5 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:16:00.450987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554eb1-bb54-438e-bc8d-4597e48addd7 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:00.451565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554eb1-bb54-438e-bc8d-4597e48addd7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:00.451565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554eb1-bb54-438e-bc8d-4597e48addd7 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:00.452842 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 435/880] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:16:00.457978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ee67-02dd-4446-a484-22dd4687e0b2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:00.458402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ee67-02dd-4446-a484-22dd4687e0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:00.458499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ee67-02dd-4446-a484-22dd4687e0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:00.477178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c715ee67-02dd-4446-a484-22dd4687e0b2 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:16:00.478332 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c715ee67-02dd-4446-a484-22dd4687e0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:16:00.542076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 446/881] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:16:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:16:00.811619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f554eb1-bb54-438e-bc8d-4597e48addd7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:00.887125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:00.910845 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f554eb1-bb54-438e-bc8d-4597e48addd7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:00.943297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014154f-82ee-438e-a1ee-b0e8b3e2fe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:00.943883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014154f-82ee-438e-a1ee-b0e8b3e2fe12 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:00.944153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014154f-82ee-438e-a1ee-b0e8b3e2fe12 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:00.944415 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014154f-82ee-438e-a1ee-b0e8b3e2fe12 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:00.945135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014154f-82ee-438e-a1ee-b0e8b3e2fe12 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:00.946479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014154f-82ee-438e-a1ee-b0e8b3e2fe12 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:00.962287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 436/882] 10.222.0.13 () {60 vars in 1138 bytes} [Wed Nov 2 07:16:00 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:16:03.144706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942b15b-7624-4c2b-a2ef-c3ac18d826ad None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:03.145262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942b15b-7624-4c2b-a2ef-c3ac18d826ad None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:03.145262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942b15b-7624-4c2b-a2ef-c3ac18d826ad None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:03.146585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 447/883] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:16:03.152239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f738f-5fca-46f6-b4fd-809d4de37660 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:03.152668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f738f-5fca-46f6-b4fd-809d4de37660 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:03.152766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f738f-5fca-46f6-b4fd-809d4de37660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:03.171340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-428f738f-5fca-46f6-b4fd-809d4de37660 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:16:03.172440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-428f738f-5fca-46f6-b4fd-809d4de37660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:16:03.236747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 437/884] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:16:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:16:03.510404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942b15b-7624-4c2b-a2ef-c3ac18d826ad None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:03.552140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:03.610660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942b15b-7624-4c2b-a2ef-c3ac18d826ad None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:03.643891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c1905-9b95-4289-9b3f-ecfe289a0235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:03.644496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c1905-9b95-4289-9b3f-ecfe289a0235 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:03.644767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c1905-9b95-4289-9b3f-ecfe289a0235 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:03.645050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c1905-9b95-4289-9b3f-ecfe289a0235 None admin] PATH_INFO: `/v3/domains/2afada7820a84dc3bb494b3f30b822e2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:03.655541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c1905-9b95-4289-9b3f-ecfe289a0235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2afada7820a84dc3bb494b3f30b822e2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:03.656967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c1905-9b95-4289-9b3f-ecfe289a0235 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:03.658546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 448/885] 10.222.0.13 () {56 vars in 1183 bytes} [Wed Nov 2 07:16:03 2022] GET /identity/v3/domains/2afada7820a84dc3bb494b3f30b822e2 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:16:03.664863 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f738f-5fca-46f6-b4fd-809d4de37660 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:03.728329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:03.764221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f738f-5fca-46f6-b4fd-809d4de37660 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:03.797015 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeffba7-933e-4465-8e9d-153beb17f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:03.797631 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeffba7-933e-4465-8e9d-153beb17f117 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:03.797908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeffba7-933e-4465-8e9d-153beb17f117 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:03.798177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeffba7-933e-4465-8e9d-153beb17f117 None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:03.798830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeffba7-933e-4465-8e9d-153beb17f117 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:03.800233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeffba7-933e-4465-8e9d-153beb17f117 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:03.827121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 438/886] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:16:03 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:16:05.999692 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdb3cb-6082-4b83-a2ae-1a63965864a8 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:06.000227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdb3cb-6082-4b83-a2ae-1a63965864a8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:06.000227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdb3cb-6082-4b83-a2ae-1a63965864a8 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:06.001584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 449/887] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:16:06.006706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f4af-ed1e-460c-9861-9aa2d39c8e7d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:06.007129 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f4af-ed1e-460c-9861-9aa2d39c8e7d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:06.007356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806f4af-ed1e-460c-9861-9aa2d39c8e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:06.025603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f806f4af-ed1e-460c-9861-9aa2d39c8e7d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:16:06.026766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f806f4af-ed1e-460c-9861-9aa2d39c8e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:16:06.090168 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 439/888] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:16:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:16:06.360680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdb3cb-6082-4b83-a2ae-1a63965864a8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:06.454941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:06.459778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdb3cb-6082-4b83-a2ae-1a63965864a8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:06.492139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea08e66-4493-455a-b3c9-bf04c3640d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:06.492751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea08e66-4493-455a-b3c9-bf04c3640d0c None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:06.493050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea08e66-4493-455a-b3c9-bf04c3640d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:06.493304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea08e66-4493-455a-b3c9-bf04c3640d0c None admin] PATH_INFO: `/v3/domains/2afada7820a84dc3bb494b3f30b822e2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:06.494401 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea08e66-4493-455a-b3c9-bf04c3640d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=2afada7820a84dc3bb494b3f30b822e2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:06.495801 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea08e66-4493-455a-b3c9-bf04c3640d0c None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:06.497354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 450/889] 10.222.0.13 () {56 vars in 1183 bytes} [Wed Nov 2 07:16:06 2022] GET /identity/v3/domains/2afada7820a84dc3bb494b3f30b822e2 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:16:06.502976 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806f4af-ed1e-460c-9861-9aa2d39c8e7d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:06.551236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:06.602451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806f4af-ed1e-460c-9861-9aa2d39c8e7d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:06.634607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc5782-646e-4c27-b4d8-12173fbe4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:06.635141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5782-646e-4c27-b4d8-12173fbe4eb9 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:06.635409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5782-646e-4c27-b4d8-12173fbe4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:06.635668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5782-646e-4c27-b4d8-12173fbe4eb9 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:06.636308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc5782-646e-4c27-b4d8-12173fbe4eb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:06.637737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc5782-646e-4c27-b4d8-12173fbe4eb9 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:06.658456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 440/890] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:16:06 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:16:08.804239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312f9f5-9dcc-4f5c-b2d6-7e9383263aea None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:08.804844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312f9f5-9dcc-4f5c-b2d6-7e9383263aea None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:08.804844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312f9f5-9dcc-4f5c-b2d6-7e9383263aea None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:08.806102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 451/891] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:16:08.811204 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08438ad9-618d-446c-8834-a05ecffac386 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:08.811583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08438ad9-618d-446c-8834-a05ecffac386 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:08.811737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08438ad9-618d-446c-8834-a05ecffac386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:08.829787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-08438ad9-618d-446c-8834-a05ecffac386 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:16:08.830948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-08438ad9-618d-446c-8834-a05ecffac386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:16:08.894028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 441/892] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:16:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:16:09.161929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312f9f5-9dcc-4f5c-b2d6-7e9383263aea None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:09.259441 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312f9f5-9dcc-4f5c-b2d6-7e9383263aea None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:09.291093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d107e6-64b1-43b7-b973-f93a5f189690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:09.291689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d107e6-64b1-43b7-b973-f93a5f189690 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:09.291958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d107e6-64b1-43b7-b973-f93a5f189690 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:09.292218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d107e6-64b1-43b7-b973-f93a5f189690 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:09.301754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d107e6-64b1-43b7-b973-f93a5f189690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-35d107e6-64b1-43b7-b973-f93a5f189690 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:16:09.307074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:16:09.308262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:16:09.309346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 452/893] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:16:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:16:09.313982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08438ad9-618d-446c-8834-a05ecffac386 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:09.347568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:09.414787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08438ad9-618d-446c-8834-a05ecffac386 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:09.448246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e5e63-cb07-4321-bb9e-b316edb625a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:09.448836 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e5e63-cb07-4321-bb9e-b316edb625a1 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:09.449140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e5e63-cb07-4321-bb9e-b316edb625a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:09.449412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e5e63-cb07-4321-bb9e-b316edb625a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:09.450065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e5e63-cb07-4321-bb9e-b316edb625a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:16:09.450363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e5e63-cb07-4321-bb9e-b316edb625a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:09.451717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e5e63-cb07-4321-bb9e-b316edb625a1 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:09.459420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 442/894] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:16:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:16:09.465121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d107e6-64b1-43b7-b973-f93a5f189690 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:09.492962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:09.562349 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d107e6-64b1-43b7-b973-f93a5f189690 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:09.595515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63772f53-0880-4146-84b4-d9a710bf4b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:09.596130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772f53-0880-4146-84b4-d9a710bf4b35 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:09.596402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772f53-0880-4146-84b4-d9a710bf4b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:09.596670 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772f53-0880-4146-84b4-d9a710bf4b35 None admin] PATH_INFO: `/v3/users/9916b972a5f240c4abf9adc70b46681c` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:09.609849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63772f53-0880-4146-84b4-d9a710bf4b35 None admin] RBAC: Authorizing `identity:get_user(user_id=9916b972a5f240c4abf9adc70b46681c)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:09.611261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63772f53-0880-4146-84b4-d9a710bf4b35 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:09.612811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 453/895] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:16:09 2022] GET /identity/v3/users/9916b972a5f240c4abf9adc70b46681c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:16:09.619141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e5e63-cb07-4321-bb9e-b316edb625a1 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:09.709559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:09.716302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e5e63-cb07-4321-bb9e-b316edb625a1 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:09.750454 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af77d35-d423-4ac0-98b8-d4e369c4acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:09.751064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af77d35-d423-4ac0-98b8-d4e369c4acaf None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:09.751341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af77d35-d423-4ac0-98b8-d4e369c4acaf None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:09.751614 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af77d35-d423-4ac0-98b8-d4e369c4acaf None admin] PATH_INFO: `/v3/projects/9d32b05a59c847deaa29b90db84d7f3b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:09.752712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af77d35-d423-4ac0-98b8-d4e369c4acaf None admin] RBAC: Authorizing `identity:get_project(project_id=9d32b05a59c847deaa29b90db84d7f3b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:09.754167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af77d35-d423-4ac0-98b8-d4e369c4acaf None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:09.755771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 443/896] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:16:09 2022] GET /identity/v3/projects/9d32b05a59c847deaa29b90db84d7f3b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:16:09.761616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63772f53-0880-4146-84b4-d9a710bf4b35 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:09.845997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:09.862658 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63772f53-0880-4146-84b4-d9a710bf4b35 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:09.895639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaf146-3f0a-41c1-b335-4ceed391c565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:09.896275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf146-3f0a-41c1-b335-4ceed391c565 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:09.896552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf146-3f0a-41c1-b335-4ceed391c565 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:09.896822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf146-3f0a-41c1-b335-4ceed391c565 None admin] PATH_INFO: `/v3/projects/9d32b05a59c847deaa29b90db84d7f3b/users/9916b972a5f240c4abf9adc70b46681c/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:09.899717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaf146-3f0a-41c1-b335-4ceed391c565 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d32b05a59c847deaa29b90db84d7f3b, user_id=9916b972a5f240c4abf9adc70b46681c, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:09.901262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaf146-3f0a-41c1-b335-4ceed391c565 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:09.915620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 454/897] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:16:09 2022] PUT /identity/v3/projects/9d32b05a59c847deaa29b90db84d7f3b/users/9916b972a5f240c4abf9adc70b46681c/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:16:12.031949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1d625-d040-4bfa-bb61-554a0e5fe29f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:12.032492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1d625-d040-4bfa-bb61-554a0e5fe29f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:12.032492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1d625-d040-4bfa-bb61-554a0e5fe29f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:12.033859 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 444/898] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:16:12.039837 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942c9d-3906-4e88-a4c9-f1fe92fc30f4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:12.040249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942c9d-3906-4e88-a4c9-f1fe92fc30f4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:12.040348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942c9d-3906-4e88-a4c9-f1fe92fc30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:12.058141 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f6942c9d-3906-4e88-a4c9-f1fe92fc30f4 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:16:12.059306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f6942c9d-3906-4e88-a4c9-f1fe92fc30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:16:12.122876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 455/899] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:16:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:16:12.396793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1d625-d040-4bfa-bb61-554a0e5fe29f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:12.495762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1d625-d040-4bfa-bb61-554a0e5fe29f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:12.527882 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867528a-a8f8-412f-99ef-2fcf23c2a926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:12.528492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867528a-a8f8-412f-99ef-2fcf23c2a926 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:12.528773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867528a-a8f8-412f-99ef-2fcf23c2a926 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:12.529142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867528a-a8f8-412f-99ef-2fcf23c2a926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:12.540293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867528a-a8f8-412f-99ef-2fcf23c2a926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3867528a-a8f8-412f-99ef-2fcf23c2a926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:16:12.545056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:16:12.546103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:16:12.547325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 445/900] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:16:12.552164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6942c9d-3906-4e88-a4c9-f1fe92fc30f4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:12.624902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:12.649690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6942c9d-3906-4e88-a4c9-f1fe92fc30f4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:12.682957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962dde5-573f-47d5-a9fd-e77ce3e9a73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:12.683542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962dde5-573f-47d5-a9fd-e77ce3e9a73d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:12.683814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962dde5-573f-47d5-a9fd-e77ce3e9a73d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:12.684080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962dde5-573f-47d5-a9fd-e77ce3e9a73d None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:12.684731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962dde5-573f-47d5-a9fd-e77ce3e9a73d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:16:12.685052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962dde5-573f-47d5-a9fd-e77ce3e9a73d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:12.686404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962dde5-573f-47d5-a9fd-e77ce3e9a73d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:12.694103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 456/901] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:16:12.700047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867528a-a8f8-412f-99ef-2fcf23c2a926 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:12.725071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:12.798723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867528a-a8f8-412f-99ef-2fcf23c2a926 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:12.830053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91adf6-1a9f-4c02-9e6c-a7093b553c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:12.830658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91adf6-1a9f-4c02-9e6c-a7093b553c6f None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:12.830928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91adf6-1a9f-4c02-9e6c-a7093b553c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:12.831193 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91adf6-1a9f-4c02-9e6c-a7093b553c6f None admin] PATH_INFO: `/v3/users/9916b972a5f240c4abf9adc70b46681c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:12.832277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91adf6-1a9f-4c02-9e6c-a7093b553c6f None admin] RBAC: Authorizing `identity:get_user(user_id=9916b972a5f240c4abf9adc70b46681c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:12.833708 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91adf6-1a9f-4c02-9e6c-a7093b553c6f None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:12.835226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 446/902] 10.222.0.13 () {56 vars in 1177 bytes} [Wed Nov 2 07:16:12 2022] GET /identity/v3/users/9916b972a5f240c4abf9adc70b46681c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:16:12.841770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962dde5-573f-47d5-a9fd-e77ce3e9a73d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:12.937901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962dde5-573f-47d5-a9fd-e77ce3e9a73d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:12.970230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01858bc-4c9c-4d38-9b7d-a7f6a8271f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:12.970817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01858bc-4c9c-4d38-9b7d-a7f6a8271f20 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:12.971090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01858bc-4c9c-4d38-9b7d-a7f6a8271f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:12.971355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01858bc-4c9c-4d38-9b7d-a7f6a8271f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:12.974662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:13.035748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01858bc-4c9c-4d38-9b7d-a7f6a8271f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:13.037195 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01858bc-4c9c-4d38-9b7d-a7f6a8271f20 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:13.130935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 457/903] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:16:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:16:13.137126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91adf6-1a9f-4c02-9e6c-a7093b553c6f None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:13.234524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:13.244164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91adf6-1a9f-4c02-9e6c-a7093b553c6f None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:13.275683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b12845-1a8d-41d2-9936-f21d6b307576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:13.276292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b12845-1a8d-41d2-9936-f21d6b307576 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:13.276566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b12845-1a8d-41d2-9936-f21d6b307576 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:13.276835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b12845-1a8d-41d2-9936-f21d6b307576 None admin] PATH_INFO: `/v3/projects/9d32b05a59c847deaa29b90db84d7f3b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:13.277951 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b12845-1a8d-41d2-9936-f21d6b307576 None admin] RBAC: Authorizing `identity:get_project(project_id=9d32b05a59c847deaa29b90db84d7f3b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:13.279367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b12845-1a8d-41d2-9936-f21d6b307576 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:13.280961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 447/904] 10.222.0.13 () {56 vars in 1186 bytes} [Wed Nov 2 07:16:13 2022] GET /identity/v3/projects/9d32b05a59c847deaa29b90db84d7f3b => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:16:13.287086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01858bc-4c9c-4d38-9b7d-a7f6a8271f20 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:16:13.321276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:13.383908 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01858bc-4c9c-4d38-9b7d-a7f6a8271f20 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:16:13.416459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abad1b-e52e-42ec-a635-d18bf3a7393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:16:13.417067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abad1b-e52e-42ec-a635-d18bf3a7393d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:16:13.417345 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abad1b-e52e-42ec-a635-d18bf3a7393d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:16:13.417611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abad1b-e52e-42ec-a635-d18bf3a7393d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:16:13.418311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abad1b-e52e-42ec-a635-d18bf3a7393d None admin] RBAC: Adding query filter params (role.id=6a01757540e64fed9041997458bd64e5, scope.project.id=9d32b05a59c847deaa29b90db84d7f3b, user.id=9916b972a5f240c4abf9adc70b46681c) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:16:13.418612 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abad1b-e52e-42ec-a635-d18bf3a7393d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:16:13.420000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abad1b-e52e-42ec-a635-d18bf3a7393d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:16:13.425511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 458/905] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:16:13 2022] GET /identity/v3/role_assignments?user.id=9916b972a5f240c4abf9adc70b46681c&scope.project.id=9d32b05a59c847deaa29b90db84d7f3b&role.id=6a01757540e64fed9041997458bd64e5 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:16:23.271640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=20 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:16:23.423012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=50 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:08.884487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efafba-0ba3-4b3f-b30b-1a68af094d89 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:08.885090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efafba-0ba3-4b3f-b30b-1a68af094d89 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:08.885090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efafba-0ba3-4b3f-b30b-1a68af094d89 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:08.886613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 448/906] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:17:08.892264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b032-2a64-4f16-956f-c66be6ef6944 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:08.892795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b032-2a64-4f16-956f-c66be6ef6944 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:08.892795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b032-2a64-4f16-956f-c66be6ef6944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:08.917881 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cf62b032-2a64-4f16-956f-c66be6ef6944 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:17:08.919185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cf62b032-2a64-4f16-956f-c66be6ef6944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:17:09.008065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 459/907] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:17:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:17:09.295161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efafba-0ba3-4b3f-b30b-1a68af094d89 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:09.432958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efafba-0ba3-4b3f-b30b-1a68af094d89 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:09.475932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cc82f-fb55-4686-8cb0-236b3687c796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:09.476580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cc82f-fb55-4686-8cb0-236b3687c796 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:09.476858 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cc82f-fb55-4686-8cb0-236b3687c796 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:09.477217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cc82f-fb55-4686-8cb0-236b3687c796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:09.488831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cc82f-fb55-4686-8cb0-236b3687c796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:09.490475 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cc82f-fb55-4686-8cb0-236b3687c796 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-d38cc82f-fb55-4686-8cb0-236b3687c796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:17:09.506913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:09.508137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:17:09.509130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:17:09.509130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:09.509130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:09.509130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 449/908] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:09.514353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62b032-2a64-4f16-956f-c66be6ef6944 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:09.644372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62b032-2a64-4f16-956f-c66be6ef6944 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:09.684997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:09.692051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf9eab-924c-4c76-9438-7b032f940452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:09.692729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf9eab-924c-4c76-9438-7b032f940452 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:09.693000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf9eab-924c-4c76-9438-7b032f940452 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:09.693322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf9eab-924c-4c76-9438-7b032f940452 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:09.694573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf9eab-924c-4c76-9438-7b032f940452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:09.694900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf9eab-924c-4c76-9438-7b032f940452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:09.696552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf9eab-924c-4c76-9438-7b032f940452 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:09.709895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 460/909] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:09.716356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cc82f-fb55-4686-8cb0-236b3687c796 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:09.787584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:09.855428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cc82f-fb55-4686-8cb0-236b3687c796 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:09.908444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ce39b-53f2-4056-a9a9-b31766bec56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:09.909111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ce39b-53f2-4056-a9a9-b31766bec56e None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:09.909363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ce39b-53f2-4056-a9a9-b31766bec56e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:09.909586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ce39b-53f2-4056-a9a9-b31766bec56e None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:09.910324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ce39b-53f2-4056-a9a9-b31766bec56e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:09.913784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ce39b-53f2-4056-a9a9-b31766bec56e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:09.945986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 450/910] 10.222.0.13 () {60 vars in 1132 bytes} [Wed Nov 2 07:17:09 2022] POST /identity/v3/users => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:17:12.696769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467910-8d79-480f-851c-97027dd48b4e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:12.697356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467910-8d79-480f-851c-97027dd48b4e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:12.697466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11467910-8d79-480f-851c-97027dd48b4e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:12.698977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 461/911] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:17:12.705144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545896f9-3173-4849-9c9c-00587b2a3fa6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:12.705748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545896f9-3173-4849-9c9c-00587b2a3fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:12.705748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545896f9-3173-4849-9c9c-00587b2a3fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:12.726052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-545896f9-3173-4849-9c9c-00587b2a3fa6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:17:12.727575 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-545896f9-3173-4849-9c9c-00587b2a3fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:17:12.813536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 451/912] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:17:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:17:13.142090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11467910-8d79-480f-851c-97027dd48b4e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:13.265547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11467910-8d79-480f-851c-97027dd48b4e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:13.312695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7290f5d-ec71-4a05-99ea-9dbeed127b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:13.313517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7290f5d-ec71-4a05-99ea-9dbeed127b61 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:13.313863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7290f5d-ec71-4a05-99ea-9dbeed127b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:13.314209 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7290f5d-ec71-4a05-99ea-9dbeed127b61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:13.326724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7290f5d-ec71-4a05-99ea-9dbeed127b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d7290f5d-ec71-4a05-99ea-9dbeed127b61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:17:13.331866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:13.332976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:17:13.333849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:13.335040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 462/913] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:17:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:17:13.340823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545896f9-3173-4849-9c9c-00587b2a3fa6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:13.388335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:13.466256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545896f9-3173-4849-9c9c-00587b2a3fa6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:13.509024 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c8fe9-202f-4b0b-8af3-ec7c87ce9b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:13.509660 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c8fe9-202f-4b0b-8af3-ec7c87ce9b23 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:13.509966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c8fe9-202f-4b0b-8af3-ec7c87ce9b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:13.510379 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c8fe9-202f-4b0b-8af3-ec7c87ce9b23 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:13.511193 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c8fe9-202f-4b0b-8af3-ec7c87ce9b23 None admin] RBAC: Adding query filter params (name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:13.511495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c8fe9-202f-4b0b-8af3-ec7c87ce9b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:13.513167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c8fe9-202f-4b0b-8af3-ec7c87ce9b23 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:13.523701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 452/914] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:17:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:13.529671 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7290f5d-ec71-4a05-99ea-9dbeed127b61 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:13.596777 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:13.654675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7290f5d-ec71-4a05-99ea-9dbeed127b61 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:13.696156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8b93c-a62b-4fa2-bac8-6201ddba5df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:13.696798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b93c-a62b-4fa2-bac8-6201ddba5df9 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:13.697422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b93c-a62b-4fa2-bac8-6201ddba5df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:13.697422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b93c-a62b-4fa2-bac8-6201ddba5df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:13.708668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8b93c-a62b-4fa2-bac8-6201ddba5df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:13.710425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8b93c-a62b-4fa2-bac8-6201ddba5df9 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-f1c8b93c-a62b-4fa2-bac8-6201ddba5df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:17:13.727473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:13.728536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:17:13.729682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:17:13.729682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:13.729682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:13.729682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 463/915] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:13.736898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c8fe9-202f-4b0b-8af3-ec7c87ce9b23 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:13.860900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:13.864497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c8fe9-202f-4b0b-8af3-ec7c87ce9b23 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:13.913049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d464add-36af-4aa4-8c1f-d7ba2f30ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:13.913318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d464add-36af-4aa4-8c1f-d7ba2f30ce7c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:13.913833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d464add-36af-4aa4-8c1f-d7ba2f30ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:13.914099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d464add-36af-4aa4-8c1f-d7ba2f30ce7c None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:13.914851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d464add-36af-4aa4-8c1f-d7ba2f30ce7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:13.915162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d464add-36af-4aa4-8c1f-d7ba2f30ce7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:13.917489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d464add-36af-4aa4-8c1f-d7ba2f30ce7c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:13.934922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 453/916] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:17:13.936758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8b93c-a62b-4fa2-bac8-6201ddba5df9 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:14.047451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8b93c-a62b-4fa2-bac8-6201ddba5df9 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:14.049099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:14.086848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8091-c226-461b-94c7-299e0a500fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:14.087779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8091-c226-461b-94c7-299e0a500fcd None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:14.088253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8091-c226-461b-94c7-299e0a500fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:14.088704 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8091-c226-461b-94c7-299e0a500fcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:14.098971 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad8091-c226-461b-94c7-299e0a500fcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:14.100908 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad8091-c226-461b-94c7-299e0a500fcd None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-76ad8091-c226-461b-94c7-299e0a500fcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:17:14.113905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:14.115098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:14.116121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:14.116121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:14.116121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:17:14.116121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:17:14.116121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:17:14.116121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:17:14.116121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:17:14.116121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:17:14.116121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:17:14.116121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:14.118708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 464/917] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:14.125367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d464add-36af-4aa4-8c1f-d7ba2f30ce7c None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:14.244262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d464add-36af-4aa4-8c1f-d7ba2f30ce7c None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:14.287017 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476faff-d4c3-4b97-8639-e712149d3240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:14.287824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476faff-d4c3-4b97-8639-e712149d3240 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:14.288602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476faff-d4c3-4b97-8639-e712149d3240 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:14.289176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476faff-d4c3-4b97-8639-e712149d3240 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:14.289981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476faff-d4c3-4b97-8639-e712149d3240 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:14.290372 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476faff-d4c3-4b97-8639-e712149d3240 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:14.292046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476faff-d4c3-4b97-8639-e712149d3240 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:14.312124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 454/918] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 2 07:17:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:14.318275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8091-c226-461b-94c7-299e0a500fcd None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:14.435564 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8091-c226-461b-94c7-299e0a500fcd None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:14.478913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8c31e-a8a7-4ee7-866e-7c983b7f3015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:14.479545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8c31e-a8a7-4ee7-866e-7c983b7f3015 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:14.479817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8c31e-a8a7-4ee7-866e-7c983b7f3015 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:14.480082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8c31e-a8a7-4ee7-866e-7c983b7f3015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:14.492565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8c31e-a8a7-4ee7-866e-7c983b7f3015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:14.494168 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8c31e-a8a7-4ee7-866e-7c983b7f3015 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-49d8c31e-a8a7-4ee7-866e-7c983b7f3015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:17:14.508487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:14.509676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:17:14.510630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:17:14.510630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:14.510630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:14.510630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 465/919] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:14.515793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476faff-d4c3-4b97-8639-e712149d3240 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:14.538893 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:14.641367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476faff-d4c3-4b97-8639-e712149d3240 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:14.685057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c81464-1871-4712-bdc1-81613e988ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:14.685522 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c81464-1871-4712-bdc1-81613e988ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:14.685797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c81464-1871-4712-bdc1-81613e988ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:14.686126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c81464-1871-4712-bdc1-81613e988ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:14.686763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c81464-1871-4712-bdc1-81613e988ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:14.687057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c81464-1871-4712-bdc1-81613e988ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:14.688414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c81464-1871-4712-bdc1-81613e988ab6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:14.702707 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 455/920] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:14.709373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8c31e-a8a7-4ee7-866e-7c983b7f3015 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:14.732799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:14.832552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8c31e-a8a7-4ee7-866e-7c983b7f3015 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:14.874724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12997a3-6142-4547-bd2c-9a8bd7a58d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:14.875387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12997a3-6142-4547-bd2c-9a8bd7a58d0d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:14.875747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12997a3-6142-4547-bd2c-9a8bd7a58d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:14.876020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12997a3-6142-4547-bd2c-9a8bd7a58d0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:14.884438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12997a3-6142-4547-bd2c-9a8bd7a58d0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:14.886281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12997a3-6142-4547-bd2c-9a8bd7a58d0d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-d12997a3-6142-4547-bd2c-9a8bd7a58d0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:17:14.899242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:14.900228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:14.901192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:17:14.901192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:17:14.901192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:17:14.901192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:17:14.901192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:17:14.901192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:17:14.901192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:17:14.901192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:14.901192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 466/921] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:14.908789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c81464-1871-4712-bdc1-81613e988ab6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:15.019501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:15.050581 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c81464-1871-4712-bdc1-81613e988ab6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:15.094056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f26f9e-6236-4f68-9313-996d252314fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:15.094764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26f9e-6236-4f68-9313-996d252314fc None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:15.095118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26f9e-6236-4f68-9313-996d252314fc None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:15.095650 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26f9e-6236-4f68-9313-996d252314fc None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:15.096429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f26f9e-6236-4f68-9313-996d252314fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:15.096732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f26f9e-6236-4f68-9313-996d252314fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:15.098488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f26f9e-6236-4f68-9313-996d252314fc None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:15.111656 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 456/922] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:15.118355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12997a3-6142-4547-bd2c-9a8bd7a58d0d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:15.207347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:15.235098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12997a3-6142-4547-bd2c-9a8bd7a58d0d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:15.276140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a921-acea-430a-b481-1fe04fc4d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:15.276854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a921-acea-430a-b481-1fe04fc4d907 None admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:15.277256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a921-acea-430a-b481-1fe04fc4d907 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:15.277622 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a921-acea-430a-b481-1fe04fc4d907 None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/55214b594a3f42ff8a7e0cecdef98937/roles/f6ee9e8014884bc5aff06380618f6aa2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:15.294891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357a921-acea-430a-b481-1fe04fc4d907 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=55214b594a3f42ff8a7e0cecdef98937, role_id=f6ee9e8014884bc5aff06380618f6aa2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:15.296565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357a921-acea-430a-b481-1fe04fc4d907 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:15.309054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 467/923] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:17:15 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/55214b594a3f42ff8a7e0cecdef98937/roles/f6ee9e8014884bc5aff06380618f6aa2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:17:17.633599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115043d-fb55-4cb0-94bf-24b09609945d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:17.634134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115043d-fb55-4cb0-94bf-24b09609945d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:17.634134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115043d-fb55-4cb0-94bf-24b09609945d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:17.635455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 457/924] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:17:17.640877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dbe6b-069d-4911-9d64-b6d66ce442d3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:17.641350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dbe6b-069d-4911-9d64-b6d66ce442d3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:17.641539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dbe6b-069d-4911-9d64-b6d66ce442d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:17.662379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b64dbe6b-069d-4911-9d64-b6d66ce442d3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:17:17.663730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b64dbe6b-069d-4911-9d64-b6d66ce442d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:17:17.739678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 468/925] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:17:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:17:18.047937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115043d-fb55-4cb0-94bf-24b09609945d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:18.171071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115043d-fb55-4cb0-94bf-24b09609945d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:18.211227 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cb913-cfc9-49d2-a369-a3e2dc6c897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:18.211960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cb913-cfc9-49d2-a369-a3e2dc6c897d None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:18.212294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cb913-cfc9-49d2-a369-a3e2dc6c897d None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:18.212509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cb913-cfc9-49d2-a369-a3e2dc6c897d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:18.221085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:18.227361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cb913-cfc9-49d2-a369-a3e2dc6c897d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-1f8cb913-cfc9-49d2-a369-a3e2dc6c897d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:17:18.232157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:18.233228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:18.234083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 458/926] 10.222.0.13 () {56 vars in 1102 bytes} [Wed Nov 2 07:17:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:18.239625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dbe6b-069d-4911-9d64-b6d66ce442d3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:18.296759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:18.347491 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dbe6b-069d-4911-9d64-b6d66ce442d3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:18.382779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bde4d-0a7a-474f-82a5-94da543dadd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:18.383384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bde4d-0a7a-474f-82a5-94da543dadd4 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:18.383660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bde4d-0a7a-474f-82a5-94da543dadd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:18.383931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bde4d-0a7a-474f-82a5-94da543dadd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:18.384586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bde4d-0a7a-474f-82a5-94da543dadd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:18.384885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bde4d-0a7a-474f-82a5-94da543dadd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:18.386287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bde4d-0a7a-474f-82a5-94da543dadd4 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:18.394799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 469/927] 10.222.0.13 () {56 vars in 1103 bytes} [Wed Nov 2 07:17:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:18.401655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cb913-cfc9-49d2-a369-a3e2dc6c897d None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:18.510706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cb913-cfc9-49d2-a369-a3e2dc6c897d None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:18.545576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b721e-a356-46f5-b731-b6d2b6468476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:18.546198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b721e-a356-46f5-b731-b6d2b6468476 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:18.546471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b721e-a356-46f5-b731-b6d2b6468476 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:18.546740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b721e-a356-46f5-b731-b6d2b6468476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:18.558502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b721e-a356-46f5-b731-b6d2b6468476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:18.560006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b721e-a356-46f5-b731-b6d2b6468476 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5d9b721e-a356-46f5-b731-b6d2b6468476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:17:18.575094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:18.576433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:17:18.577546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:17:18.577546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:18.577546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:18.577546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 459/928] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:18.583834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bde4d-0a7a-474f-82a5-94da543dadd4 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:18.695621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bde4d-0a7a-474f-82a5-94da543dadd4 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:18.712789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:18.735921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc349d71-9a5e-412d-a388-f482304fb817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:18.736590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc349d71-9a5e-412d-a388-f482304fb817 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:18.736894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc349d71-9a5e-412d-a388-f482304fb817 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:18.737185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc349d71-9a5e-412d-a388-f482304fb817 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:18.737925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc349d71-9a5e-412d-a388-f482304fb817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:18.738228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc349d71-9a5e-412d-a388-f482304fb817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:18.739641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc349d71-9a5e-412d-a388-f482304fb817 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:18.752191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 470/929] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:18.758079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b721e-a356-46f5-b731-b6d2b6468476 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:18.812173 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:18.867350 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b721e-a356-46f5-b731-b6d2b6468476 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:18.905728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a0d0e-ec10-4050-b645-8bebeabf26ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:18.906379 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a0d0e-ec10-4050-b645-8bebeabf26ad None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:18.906664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a0d0e-ec10-4050-b645-8bebeabf26ad None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:18.906992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a0d0e-ec10-4050-b645-8bebeabf26ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:18.917583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a0d0e-ec10-4050-b645-8bebeabf26ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:18.919019 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a0d0e-ec10-4050-b645-8bebeabf26ad None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-501a0d0e-ec10-4050-b645-8bebeabf26ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:17:18.932325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:18.933562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:18.934818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 460/930] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:17:18.941489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc349d71-9a5e-412d-a388-f482304fb817 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:19.045821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc349d71-9a5e-412d-a388-f482304fb817 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:19.078362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b7571-c720-42a1-a672-306f5edadcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:19.078878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7571-c720-42a1-a672-306f5edadcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:19.079148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7571-c720-42a1-a672-306f5edadcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:19.079408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b7571-c720-42a1-a672-306f5edadcd7 None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:19.080114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b7571-c720-42a1-a672-306f5edadcd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:19.080410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b7571-c720-42a1-a672-306f5edadcd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:19.082155 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b7571-c720-42a1-a672-306f5edadcd7 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:19.102265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 471/931] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 2 07:17:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:19.108159 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a0d0e-ec10-4050-b645-8bebeabf26ad None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:19.227253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a0d0e-ec10-4050-b645-8bebeabf26ad None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:19.237806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:19.266555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc5a6f-3066-4082-bc27-5f153b2422e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:19.267261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc5a6f-3066-4082-bc27-5f153b2422e5 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:19.267537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc5a6f-3066-4082-bc27-5f153b2422e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:19.267804 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc5a6f-3066-4082-bc27-5f153b2422e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:19.345073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc5a6f-3066-4082-bc27-5f153b2422e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:19.346720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc5a6f-3066-4082-bc27-5f153b2422e5 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:19.451238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 461/932] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:17:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:17:19.457127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b7571-c720-42a1-a672-306f5edadcd7 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:19.495068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:19.569642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b7571-c720-42a1-a672-306f5edadcd7 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:19.615549 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84317-0bee-46cb-98d7-0952310a0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:19.616259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84317-0bee-46cb-98d7-0952310a0312 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:19.616543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84317-0bee-46cb-98d7-0952310a0312 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:19.616820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84317-0bee-46cb-98d7-0952310a0312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:19.626840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84317-0bee-46cb-98d7-0952310a0312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:19.628265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84317-0bee-46cb-98d7-0952310a0312 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-29e84317-0bee-46cb-98d7-0952310a0312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:17:19.643664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:19.644985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:17:19.646319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:17:19.646319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:19.646319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:19.650068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 472/933] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:19.651332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc5a6f-3066-4082-bc27-5f153b2422e5 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:19.663983 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:19.766334 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc5a6f-3066-4082-bc27-5f153b2422e5 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:19.810364 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed73998-fff9-4fe6-a45e-a0b31ebebe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:19.811269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed73998-fff9-4fe6-a45e-a0b31ebebe3e None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:19.811724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed73998-fff9-4fe6-a45e-a0b31ebebe3e None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:19.812067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed73998-fff9-4fe6-a45e-a0b31ebebe3e None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:19.812903 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed73998-fff9-4fe6-a45e-a0b31ebebe3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:19.813265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed73998-fff9-4fe6-a45e-a0b31ebebe3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:19.814680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed73998-fff9-4fe6-a45e-a0b31ebebe3e None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:19.830449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 462/934] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:19.837619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84317-0bee-46cb-98d7-0952310a0312 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:19.937798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:19.956126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84317-0bee-46cb-98d7-0952310a0312 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:19.990500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a8b09-e0fc-4d4e-ba33-8c6e337d4b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:19.991380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8b09-e0fc-4d4e-ba33-8c6e337d4b40 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:19.991737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8b09-e0fc-4d4e-ba33-8c6e337d4b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:19.992081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8b09-e0fc-4d4e-ba33-8c6e337d4b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:19.998905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a8b09-e0fc-4d4e-ba33-8c6e337d4b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:20.000411 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a8b09-e0fc-4d4e-ba33-8c6e337d4b40 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-089a8b09-e0fc-4d4e-ba33-8c6e337d4b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:17:20.012330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:20.013500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:20.015001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:17:20.015001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:17:20.015001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:17:20.015001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:17:20.015001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:17:20.015001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:17:20.015001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:17:20.015001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:20.015001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 473/935] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:20.019822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed73998-fff9-4fe6-a45e-a0b31ebebe3e None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:20.092438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:20.125819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed73998-fff9-4fe6-a45e-a0b31ebebe3e None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:20.166750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec59825-b920-44b6-a6cf-04cd5c21f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:20.167313 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec59825-b920-44b6-a6cf-04cd5c21f43c None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:20.167587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec59825-b920-44b6-a6cf-04cd5c21f43c None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:20.167858 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec59825-b920-44b6-a6cf-04cd5c21f43c None admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:20.168623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec59825-b920-44b6-a6cf-04cd5c21f43c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:20.168926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec59825-b920-44b6-a6cf-04cd5c21f43c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:20.170436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec59825-b920-44b6-a6cf-04cd5c21f43c None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:20.183612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 463/936] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:17:20.189909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a8b09-e0fc-4d4e-ba33-8c6e337d4b40 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:20.299562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a8b09-e0fc-4d4e-ba33-8c6e337d4b40 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:20.338513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d671a5-e097-4b76-993b-824712025fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:20.339109 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d671a5-e097-4b76-993b-824712025fac None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:20.339382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d671a5-e097-4b76-993b-824712025fac None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:20.339655 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d671a5-e097-4b76-993b-824712025fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:20.340365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d671a5-e097-4b76-993b-824712025fac None admin] RBAC: Adding query filter params (role.id=f6ee9e8014884bc5aff06380618f6aa2, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=55214b594a3f42ff8a7e0cecdef98937) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:20.340666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d671a5-e097-4b76-993b-824712025fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:20.342315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d671a5-e097-4b76-993b-824712025fac None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:20.349559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 474/937] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:17:20 2022] GET /identity/v3/role_assignments?user.id=55214b594a3f42ff8a7e0cecdef98937&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=f6ee9e8014884bc5aff06380618f6aa2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:22.832375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965e746-2dc0-496e-8b0b-d8b881017ed8 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:22.832912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965e746-2dc0-496e-8b0b-d8b881017ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:22.832912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965e746-2dc0-496e-8b0b-d8b881017ed8 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:22.834621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 464/938] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:17:22.841818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d417686-bb59-4452-8731-216b14d24689 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:22.842364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d417686-bb59-4452-8731-216b14d24689 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:22.842364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d417686-bb59-4452-8731-216b14d24689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:22.863310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1d417686-bb59-4452-8731-216b14d24689 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:17:22.864559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1d417686-bb59-4452-8731-216b14d24689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:17:22.868977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:22.944857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 475/939] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:17:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:17:23.242056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965e746-2dc0-496e-8b0b-d8b881017ed8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:23.364455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965e746-2dc0-496e-8b0b-d8b881017ed8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:23.400169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:23.406595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c202f16-af8f-4cb6-a6c0-65c01ad3c3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:23.407308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c202f16-af8f-4cb6-a6c0-65c01ad3c3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:23.407601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c202f16-af8f-4cb6-a6c0-65c01ad3c3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:23.407864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c202f16-af8f-4cb6-a6c0-65c01ad3c3e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:23.418553 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c202f16-af8f-4cb6-a6c0-65c01ad3c3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-6c202f16-af8f-4cb6-a6c0-65c01ad3c3e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:17:23.423363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:23.424535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:23.425543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 465/940] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:23.431224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d417686-bb59-4452-8731-216b14d24689 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:23.540131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d417686-bb59-4452-8731-216b14d24689 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:23.578327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039deba-7fd7-4232-8c98-8cfafdfa0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:23.579037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039deba-7fd7-4232-8c98-8cfafdfa0e3e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:23.579303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039deba-7fd7-4232-8c98-8cfafdfa0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:23.579841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039deba-7fd7-4232-8c98-8cfafdfa0e3e None admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:23.580567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039deba-7fd7-4232-8c98-8cfafdfa0e3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:23.580984 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039deba-7fd7-4232-8c98-8cfafdfa0e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:23.582860 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039deba-7fd7-4232-8c98-8cfafdfa0e3e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:23.592510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 476/941] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:17:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:17:23.599438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c202f16-af8f-4cb6-a6c0-65c01ad3c3e2 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:23.719197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c202f16-af8f-4cb6-a6c0-65c01ad3c3e2 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:23.761969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df988ba-c0bc-4d36-9833-16757f03f894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:23.762873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df988ba-c0bc-4d36-9833-16757f03f894 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:23.763292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df988ba-c0bc-4d36-9833-16757f03f894 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:23.763782 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df988ba-c0bc-4d36-9833-16757f03f894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:23.778274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df988ba-c0bc-4d36-9833-16757f03f894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:23.780528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df988ba-c0bc-4d36-9833-16757f03f894 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-4df988ba-c0bc-4d36-9833-16757f03f894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:17:23.806855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:23.808016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:17:23.809111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:17:23.809111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:23.809111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:23.809111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 466/942] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:23.815185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039deba-7fd7-4232-8c98-8cfafdfa0e3e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:23.818504 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:23.935114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039deba-7fd7-4232-8c98-8cfafdfa0e3e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:23.972874 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b2528-ce03-4977-b80a-6d119d4d5b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:23.973659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2528-ce03-4977-b80a-6d119d4d5b28 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:23.974057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2528-ce03-4977-b80a-6d119d4d5b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:23.974399 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2528-ce03-4977-b80a-6d119d4d5b28 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:23.975282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b2528-ce03-4977-b80a-6d119d4d5b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:23.975605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b2528-ce03-4977-b80a-6d119d4d5b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:23.977091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b2528-ce03-4977-b80a-6d119d4d5b28 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:23.991042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 477/943] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:23.997668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df988ba-c0bc-4d36-9833-16757f03f894 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:24.044567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:24.111079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df988ba-c0bc-4d36-9833-16757f03f894 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:24.150410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54116f-6fa4-47b0-807f-992404434382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:24.151041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54116f-6fa4-47b0-807f-992404434382 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:24.151319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54116f-6fa4-47b0-807f-992404434382 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:24.151588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54116f-6fa4-47b0-807f-992404434382 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:24.160045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54116f-6fa4-47b0-807f-992404434382 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:24.161647 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54116f-6fa4-47b0-807f-992404434382 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-ec54116f-6fa4-47b0-807f-992404434382 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:17:24.175246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:24.176421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:24.177527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 467/944] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:24.183278 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b2528-ce03-4977-b80a-6d119d4d5b28 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:24.261841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:24.310476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b2528-ce03-4977-b80a-6d119d4d5b28 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:24.352087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cef20b-acdb-4075-a3ba-e4bebce1182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:24.352683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cef20b-acdb-4075-a3ba-e4bebce1182e None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:24.352952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cef20b-acdb-4075-a3ba-e4bebce1182e None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:24.353262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cef20b-acdb-4075-a3ba-e4bebce1182e None admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:24.353975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cef20b-acdb-4075-a3ba-e4bebce1182e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:24.354272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cef20b-acdb-4075-a3ba-e4bebce1182e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:24.355719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cef20b-acdb-4075-a3ba-e4bebce1182e None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:24.376055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 478/945] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 2 07:17:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:24.382362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54116f-6fa4-47b0-807f-992404434382 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:24.493330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54116f-6fa4-47b0-807f-992404434382 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:24.494908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:24.535691 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18dba8-8690-4bdd-8223-8cc55800ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:24.536353 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18dba8-8690-4bdd-8223-8cc55800ddbd None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:24.536635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18dba8-8690-4bdd-8223-8cc55800ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:24.536910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18dba8-8690-4bdd-8223-8cc55800ddbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:24.550272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18dba8-8690-4bdd-8223-8cc55800ddbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:24.551736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18dba8-8690-4bdd-8223-8cc55800ddbd None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-cc18dba8-8690-4bdd-8223-8cc55800ddbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:17:24.570177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:24.571464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:17:24.572552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:17:24.572552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:24.572552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:24.573514 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 468/946] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:24.578242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cef20b-acdb-4075-a3ba-e4bebce1182e None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:24.693092 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cef20b-acdb-4075-a3ba-e4bebce1182e None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:24.715693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:24.732248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8167f10-7d29-495f-ba9f-84fbf10db81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:24.732721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8167f10-7d29-495f-ba9f-84fbf10db81d None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:24.733052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8167f10-7d29-495f-ba9f-84fbf10db81d None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:24.733323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8167f10-7d29-495f-ba9f-84fbf10db81d None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:24.734008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8167f10-7d29-495f-ba9f-84fbf10db81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:24.734368 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8167f10-7d29-495f-ba9f-84fbf10db81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:24.735822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8167f10-7d29-495f-ba9f-84fbf10db81d None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:24.748137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 479/947] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:24.754324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18dba8-8690-4bdd-8223-8cc55800ddbd None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:24.864893 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18dba8-8690-4bdd-8223-8cc55800ddbd None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:24.903851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a32bb-e035-4910-8bb4-414f9e321562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:24.904526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a32bb-e035-4910-8bb4-414f9e321562 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:24.904806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a32bb-e035-4910-8bb4-414f9e321562 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:24.905106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a32bb-e035-4910-8bb4-414f9e321562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:24.914213 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a32bb-e035-4910-8bb4-414f9e321562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:24.915659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a32bb-e035-4910-8bb4-414f9e321562 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-5a3a32bb-e035-4910-8bb4-414f9e321562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:17:24.928355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:24.929649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:24.931018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:17:24.931018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:17:24.931018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:17:24.931018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:17:24.931018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:17:24.931018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:17:24.931018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:17:24.931018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:24.931018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 469/948] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:17:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:24.935585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8167f10-7d29-495f-ba9f-84fbf10db81d None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:25.055095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8167f10-7d29-495f-ba9f-84fbf10db81d None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:25.096192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a3d8d-dfeb-4a95-a369-9779bdeb87aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:25.096853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a3d8d-dfeb-4a95-a369-9779bdeb87aa None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:25.097127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a3d8d-dfeb-4a95-a369-9779bdeb87aa None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:25.097588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a3d8d-dfeb-4a95-a369-9779bdeb87aa None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:25.098458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a3d8d-dfeb-4a95-a369-9779bdeb87aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:25.098752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a3d8d-dfeb-4a95-a369-9779bdeb87aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:25.101201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a3d8d-dfeb-4a95-a369-9779bdeb87aa None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:25.117493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 480/949] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:17:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:25.123885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a32bb-e035-4910-8bb4-414f9e321562 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:25.141843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:25.231966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a32bb-e035-4910-8bb4-414f9e321562 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:25.267390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06fe1e-c439-427a-b8f2-7fecc68a1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:25.268134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fe1e-c439-427a-b8f2-7fecc68a1b19 None admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:25.268452 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fe1e-c439-427a-b8f2-7fecc68a1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:25.268800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fe1e-c439-427a-b8f2-7fecc68a1b19 None admin] PATH_INFO: `/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/55214b594a3f42ff8a7e0cecdef98937/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:25.270782 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06fe1e-c439-427a-b8f2-7fecc68a1b19 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8fa018afb294bfc82c59a82497ed9c3, user_id=55214b594a3f42ff8a7e0cecdef98937, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:25.272971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06fe1e-c439-427a-b8f2-7fecc68a1b19 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:25.287202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 470/950] 10.222.0.13 () {58 vars in 1439 bytes} [Wed Nov 2 07:17:25 2022] PUT /identity/v3/projects/f8fa018afb294bfc82c59a82497ed9c3/users/55214b594a3f42ff8a7e0cecdef98937/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:17:27.618804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97514937-5851-4975-96a8-ddd26e3444f8 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:27.619840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97514937-5851-4975-96a8-ddd26e3444f8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:27.619840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97514937-5851-4975-96a8-ddd26e3444f8 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:27.620866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 481/951] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:17:27.626618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43abf-3618-438b-b273-61c773f4563b None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:27.627080 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43abf-3618-438b-b273-61c773f4563b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:27.627235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43abf-3618-438b-b273-61c773f4563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:27.648916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-91f43abf-3618-438b-b273-61c773f4563b None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:17:27.650266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-91f43abf-3618-438b-b273-61c773f4563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:17:27.721641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 471/952] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:17:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:17:28.026178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97514937-5851-4975-96a8-ddd26e3444f8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:28.074595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:28.141330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97514937-5851-4975-96a8-ddd26e3444f8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:28.176879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e048b2-2a8e-43d9-9f0c-a0e6e8f88e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:28.177436 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e048b2-2a8e-43d9-9f0c-a0e6e8f88e98 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:28.177709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e048b2-2a8e-43d9-9f0c-a0e6e8f88e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:28.178116 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e048b2-2a8e-43d9-9f0c-a0e6e8f88e98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:28.188530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e048b2-2a8e-43d9-9f0c-a0e6e8f88e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-05e048b2-2a8e-43d9-9f0c-a0e6e8f88e98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:17:28.193410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:28.201325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:28.202257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 482/953] 10.222.0.13 () {56 vars in 1096 bytes} [Wed Nov 2 07:17:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:28.202977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f43abf-3618-438b-b273-61c773f4563b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:28.206234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:28.310409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f43abf-3618-438b-b273-61c773f4563b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:28.348133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342090-56b0-4214-9506-06f41f9e3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:28.348816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342090-56b0-4214-9506-06f41f9e3628 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:28.349089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342090-56b0-4214-9506-06f41f9e3628 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:28.349361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342090-56b0-4214-9506-06f41f9e3628 None admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:28.350830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97342090-56b0-4214-9506-06f41f9e3628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:28.351167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97342090-56b0-4214-9506-06f41f9e3628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:28.352481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97342090-56b0-4214-9506-06f41f9e3628 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:28.362044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 472/954] 10.222.0.13 () {56 vars in 1099 bytes} [Wed Nov 2 07:17:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:28.369225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e048b2-2a8e-43d9-9f0c-a0e6e8f88e98 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:28.486184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:28.489336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e048b2-2a8e-43d9-9f0c-a0e6e8f88e98 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:28.527903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ed21f-d7fc-470f-9b99-e2859f75a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:28.528548 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ed21f-d7fc-470f-9b99-e2859f75a536 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:28.528822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ed21f-d7fc-470f-9b99-e2859f75a536 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:28.529122 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ed21f-d7fc-470f-9b99-e2859f75a536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:28.540904 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ed21f-d7fc-470f-9b99-e2859f75a536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:28.542402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ed21f-d7fc-470f-9b99-e2859f75a536 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-695ed21f-d7fc-470f-9b99-e2859f75a536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:17:28.557773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:28.563906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:17:28.564861 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:17:28.564861 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:28.564861 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:28.564861 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 483/955] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:28.565120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342090-56b0-4214-9506-06f41f9e3628 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:28.647873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:28.685410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342090-56b0-4214-9506-06f41f9e3628 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:28.719771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013cf7b-0bfb-4d92-bc6b-161264e44632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:28.720639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013cf7b-0bfb-4d92-bc6b-161264e44632 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:28.720914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013cf7b-0bfb-4d92-bc6b-161264e44632 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:28.721206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013cf7b-0bfb-4d92-bc6b-161264e44632 None admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:28.721854 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013cf7b-0bfb-4d92-bc6b-161264e44632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:28.722150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013cf7b-0bfb-4d92-bc6b-161264e44632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:28.723531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013cf7b-0bfb-4d92-bc6b-161264e44632 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:28.736994 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 473/956] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:28.743096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ed21f-d7fc-470f-9b99-e2859f75a536 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:28.851530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ed21f-d7fc-470f-9b99-e2859f75a536 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:28.886898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafe8e2-9196-4b98-ae88-4f43546b402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:28.887522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe8e2-9196-4b98-ae88-4f43546b402a None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:28.887794 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe8e2-9196-4b98-ae88-4f43546b402a None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:28.888058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe8e2-9196-4b98-ae88-4f43546b402a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:28.895669 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafe8e2-9196-4b98-ae88-4f43546b402a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:28.897807 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafe8e2-9196-4b98-ae88-4f43546b402a None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9dafe8e2-9196-4b98-ae88-4f43546b402a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:17:28.909084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:28.910056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:28.911014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 484/957] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:28.916437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013cf7b-0bfb-4d92-bc6b-161264e44632 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:29.019022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013cf7b-0bfb-4d92-bc6b-161264e44632 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:29.045099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:29.055554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46a11a-1a77-4467-b4a7-fc1db33154b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:29.056161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46a11a-1a77-4467-b4a7-fc1db33154b6 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:29.056438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46a11a-1a77-4467-b4a7-fc1db33154b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:29.056707 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46a11a-1a77-4467-b4a7-fc1db33154b6 None admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:29.057477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46a11a-1a77-4467-b4a7-fc1db33154b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:29.057779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46a11a-1a77-4467-b4a7-fc1db33154b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:29.059196 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46a11a-1a77-4467-b4a7-fc1db33154b6 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:29.077338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 474/958] 10.222.0.13 () {56 vars in 1143 bytes} [Wed Nov 2 07:17:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:29.083284 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafe8e2-9196-4b98-ae88-4f43546b402a None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:29.099648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:29.189511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafe8e2-9196-4b98-ae88-4f43546b402a None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:29.222350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207179a6-1d90-4a81-b6ff-445f8237eb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:29.222972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207179a6-1d90-4a81-b6ff-445f8237eb92 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:29.223252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207179a6-1d90-4a81-b6ff-445f8237eb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:29.223519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207179a6-1d90-4a81-b6ff-445f8237eb92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:29.288895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207179a6-1d90-4a81-b6ff-445f8237eb92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:29.290293 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207179a6-1d90-4a81-b6ff-445f8237eb92 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:29.303243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:29.385420 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 485/959] 10.222.0.13 () {58 vars in 1282 bytes} [Wed Nov 2 07:17:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:17:29.391242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46a11a-1a77-4467-b4a7-fc1db33154b6 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:29.488900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46a11a-1a77-4467-b4a7-fc1db33154b6 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:29.522135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955c745-20d9-470f-b8e0-5d9ba8c19c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:29.522742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955c745-20d9-470f-b8e0-5d9ba8c19c74 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:29.523008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955c745-20d9-470f-b8e0-5d9ba8c19c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:29.523266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955c745-20d9-470f-b8e0-5d9ba8c19c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:29.532827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955c745-20d9-470f-b8e0-5d9ba8c19c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:29.534269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955c745-20d9-470f-b8e0-5d9ba8c19c74 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-3955c745-20d9-470f-b8e0-5d9ba8c19c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:17:29.548805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:29.549932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:17:29.551043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:17:29.551043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:17:29.551043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:29.551043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 475/960] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:29.555603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207179a6-1d90-4a81-b6ff-445f8237eb92 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:29.669815 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207179a6-1d90-4a81-b6ff-445f8237eb92 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:29.682423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:29.703133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1537eab-b258-4116-a799-a0864a259e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:29.703726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1537eab-b258-4116-a799-a0864a259e92 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:29.704024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1537eab-b258-4116-a799-a0864a259e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:29.704267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1537eab-b258-4116-a799-a0864a259e92 None admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:29.704890 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1537eab-b258-4116-a799-a0864a259e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:29.705219 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1537eab-b258-4116-a799-a0864a259e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:29.706560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1537eab-b258-4116-a799-a0864a259e92 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:29.717857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 486/961] 10.222.0.13 () {56 vars in 1109 bytes} [Wed Nov 2 07:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:29.723905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955c745-20d9-470f-b8e0-5d9ba8c19c74 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:29.759271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:29.822394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955c745-20d9-470f-b8e0-5d9ba8c19c74 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:29.854732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e14d64-276e-4e73-981e-48d8f1887c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:29.855338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e14d64-276e-4e73-981e-48d8f1887c65 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:29.855610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e14d64-276e-4e73-981e-48d8f1887c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:29.855873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e14d64-276e-4e73-981e-48d8f1887c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:29.862225 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e14d64-276e-4e73-981e-48d8f1887c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:29.863639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e14d64-276e-4e73-981e-48d8f1887c65 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application [None req-24e14d64-276e-4e73-981e-48d8f1887c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:17:29.874750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:29.875787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:29.877040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:17:29.877040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:17:29.877040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:17:29.877040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:17:29.877040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:17:29.877040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:17:29.877040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:17:29.877040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: ERROR keystone.server.flask.application Nov 02 07:17:29.877040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 476/962] 10.222.0.13 () {56 vars in 1111 bytes} [Wed Nov 2 07:17:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:29.882675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1537eab-b258-4116-a799-a0864a259e92 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:29.981479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1537eab-b258-4116-a799-a0864a259e92 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:30.014401 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040981cc-1bdc-41f4-9034-2123a9652354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:30.014991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040981cc-1bdc-41f4-9034-2123a9652354 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:30.015268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040981cc-1bdc-41f4-9034-2123a9652354 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:30.015536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040981cc-1bdc-41f4-9034-2123a9652354 None admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:30.016207 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040981cc-1bdc-41f4-9034-2123a9652354 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:30.016507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040981cc-1bdc-41f4-9034-2123a9652354 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:30.017932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040981cc-1bdc-41f4-9034-2123a9652354 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:30.029620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 487/963] 10.222.0.13 () {56 vars in 1148 bytes} [Wed Nov 2 07:17:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:17:30.035685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e14d64-276e-4e73-981e-48d8f1887c65 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:30.127396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:30.134201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e14d64-276e-4e73-981e-48d8f1887c65 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:30.165790 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b8f46-66aa-48f7-a5d8-915fdfbe05c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:30.166373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b8f46-66aa-48f7-a5d8-915fdfbe05c2 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:30.166647 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b8f46-66aa-48f7-a5d8-915fdfbe05c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:30.166915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b8f46-66aa-48f7-a5d8-915fdfbe05c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:30.167622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b8f46-66aa-48f7-a5d8-915fdfbe05c2 None admin] RBAC: Adding query filter params (role.id=6a01757540e64fed9041997458bd64e5, scope.project.id=f8fa018afb294bfc82c59a82497ed9c3, user.id=55214b594a3f42ff8a7e0cecdef98937) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:30.167924 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b8f46-66aa-48f7-a5d8-915fdfbe05c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:30.169356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b8f46-66aa-48f7-a5d8-915fdfbe05c2 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:30.174890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 477/964] 10.222.0.13 () {56 vars in 1374 bytes} [Wed Nov 2 07:17:30 2022] GET /identity/v3/role_assignments?user.id=55214b594a3f42ff8a7e0cecdef98937&scope.project.id=f8fa018afb294bfc82c59a82497ed9c3&role.id=6a01757540e64fed9041997458bd64e5 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:32.324539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a4847-d0d4-493c-8314-352ca3f488b5 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:32.325134 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a4847-d0d4-493c-8314-352ca3f488b5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:32.325134 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a4847-d0d4-493c-8314-352ca3f488b5 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:32.326435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 488/965] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:17:32.331693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889707-6ed1-46bc-bd25-6417dbfe2b23 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:32.332141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889707-6ed1-46bc-bd25-6417dbfe2b23 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:32.332242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73889707-6ed1-46bc-bd25-6417dbfe2b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:32.351171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-73889707-6ed1-46bc-bd25-6417dbfe2b23 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:17:32.352322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-73889707-6ed1-46bc-bd25-6417dbfe2b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:17:32.417300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 478/966] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:17:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:17:32.689440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a4847-d0d4-493c-8314-352ca3f488b5 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:32.719508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:32.788689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a4847-d0d4-493c-8314-352ca3f488b5 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:32.821238 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c224355-4a1a-47ca-8125-29bb1fe2f044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:32.821843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224355-4a1a-47ca-8125-29bb1fe2f044 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:32.822115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224355-4a1a-47ca-8125-29bb1fe2f044 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:32.822381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224355-4a1a-47ca-8125-29bb1fe2f044 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:32.822948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c224355-4a1a-47ca-8125-29bb1fe2f044 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:32.824287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c224355-4a1a-47ca-8125-29bb1fe2f044 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-9c224355-4a1a-47ca-8125-29bb1fe2f044 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:32.832747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:32.834158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:32.835295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 489/967] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 07:17:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:32.839942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73889707-6ed1-46bc-bd25-6417dbfe2b23 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:32.929132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:32.938779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73889707-6ed1-46bc-bd25-6417dbfe2b23 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:32.971064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7ddf-2857-4625-8d75-163a37e5567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:32.971598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7ddf-2857-4625-8d75-163a37e5567a None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:32.971865 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7ddf-2857-4625-8d75-163a37e5567a None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:32.972127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7ddf-2857-4625-8d75-163a37e5567a None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:32.972739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a7ddf-2857-4625-8d75-163a37e5567a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:32.973060 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a7ddf-2857-4625-8d75-163a37e5567a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:32.974433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a7ddf-2857-4625-8d75-163a37e5567a None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:32.979570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 479/968] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Nov 2 07:17:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:32.985496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c224355-4a1a-47ca-8125-29bb1fe2f044 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:33.076008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:33.081830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c224355-4a1a-47ca-8125-29bb1fe2f044 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:33.114543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f6ab4-cea0-49b5-9739-81379f33ce09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:33.115119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6ab4-cea0-49b5-9739-81379f33ce09 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:33.115520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6ab4-cea0-49b5-9739-81379f33ce09 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:33.115792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6ab4-cea0-49b5-9739-81379f33ce09 None admin] PATH_INFO: `/v3/services` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:33.116407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f6ab4-cea0-49b5-9739-81379f33ce09 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:33.116705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f6ab4-cea0-49b5-9739-81379f33ce09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:33.118081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f6ab4-cea0-49b5-9739-81379f33ce09 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:33.122288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 490/969] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Nov 2 07:17:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:35.244187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35338565-28ae-44a7-bdf9-93b9e9ff4ced None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:35.244710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35338565-28ae-44a7-bdf9-93b9e9ff4ced None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:35.244710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35338565-28ae-44a7-bdf9-93b9e9ff4ced None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:35.245981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 480/970] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:17:35.251057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f71f2-d658-49ea-9916-a4db265e67f1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:35.251475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f71f2-d658-49ea-9916-a4db265e67f1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:35.251606 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f71f2-d658-49ea-9916-a4db265e67f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:35.269934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6a8f71f2-d658-49ea-9916-a4db265e67f1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:17:35.271118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6a8f71f2-d658-49ea-9916-a4db265e67f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:17:35.340883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 491/971] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:17:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:17:35.620954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35338565-28ae-44a7-bdf9-93b9e9ff4ced None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:35.720251 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35338565-28ae-44a7-bdf9-93b9e9ff4ced None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:35.754051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ade842-df4f-4490-a3f8-3423f71f9621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:35.754639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ade842-df4f-4490-a3f8-3423f71f9621 None admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:35.754910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ade842-df4f-4490-a3f8-3423f71f9621 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:35.755176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ade842-df4f-4490-a3f8-3423f71f9621 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:35.755824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ade842-df4f-4490-a3f8-3423f71f9621 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:35.757221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ade842-df4f-4490-a3f8-3423f71f9621 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:35.770580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 481/972] 10.222.0.13 () {60 vars in 1141 bytes} [Wed Nov 2 07:17:35 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:17:37.918462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c35de7-fa89-4678-8a2e-523e587a1d0d None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:37.918915 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c35de7-fa89-4678-8a2e-523e587a1d0d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:37.919014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c35de7-fa89-4678-8a2e-523e587a1d0d None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:37.920353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 492/973] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:17:37.926030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d53341-e0e0-4483-9a13-6da7b1eaeb9e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:37.926427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d53341-e0e0-4483-9a13-6da7b1eaeb9e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:37.926568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d53341-e0e0-4483-9a13-6da7b1eaeb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:37.944585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b3d53341-e0e0-4483-9a13-6da7b1eaeb9e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:17:37.945777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b3d53341-e0e0-4483-9a13-6da7b1eaeb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:17:37.954636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:38.016720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 482/974] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:17:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:17:38.282189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c35de7-fa89-4678-8a2e-523e587a1d0d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:38.371727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:38.382461 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c35de7-fa89-4678-8a2e-523e587a1d0d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:38.414333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b30e-619e-4ece-9d9d-ffca379db4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:38.414942 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b30e-619e-4ece-9d9d-ffca379db4cc None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:38.415213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b30e-619e-4ece-9d9d-ffca379db4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:38.415477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b30e-619e-4ece-9d9d-ffca379db4cc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:38.416037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48b30e-619e-4ece-9d9d-ffca379db4cc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:38.417406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48b30e-619e-4ece-9d9d-ffca379db4cc None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-6b48b30e-619e-4ece-9d9d-ffca379db4cc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:38.425765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:38.426925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:38.428477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 493/975] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 07:17:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:38.433325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d53341-e0e0-4483-9a13-6da7b1eaeb9e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:38.529425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d53341-e0e0-4483-9a13-6da7b1eaeb9e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:38.564036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06cc64-19cb-45b0-8f5b-7511f0e71c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:38.564766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06cc64-19cb-45b0-8f5b-7511f0e71c81 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:38.564951 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06cc64-19cb-45b0-8f5b-7511f0e71c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:38.565187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06cc64-19cb-45b0-8f5b-7511f0e71c81 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:38.565836 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06cc64-19cb-45b0-8f5b-7511f0e71c81 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:38.566112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06cc64-19cb-45b0-8f5b-7511f0e71c81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:38.567465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06cc64-19cb-45b0-8f5b-7511f0e71c81 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:38.573016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 483/976] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Nov 2 07:17:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:38.579476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b30e-619e-4ece-9d9d-ffca379db4cc None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:38.680990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b30e-619e-4ece-9d9d-ffca379db4cc None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:38.713773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50043426-14b7-4dcc-8f96-05ca94ce6738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:38.714366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043426-14b7-4dcc-8f96-05ca94ce6738 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:38.714637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043426-14b7-4dcc-8f96-05ca94ce6738 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:38.714901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043426-14b7-4dcc-8f96-05ca94ce6738 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:38.715589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50043426-14b7-4dcc-8f96-05ca94ce6738 None admin] RBAC: Adding query filter params (interface=public, service_id=09fe035dcb39429781d196e8369ab4c8, region_id=RegionOne) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:38.715892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50043426-14b7-4dcc-8f96-05ca94ce6738 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:38.717274 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50043426-14b7-4dcc-8f96-05ca94ce6738 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:38.722309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 494/977] 10.222.0.13 () {56 vars in 1251 bytes} [Wed Nov 2 07:17:38 2022] GET /identity/v3/endpoints?service_id=09fe035dcb39429781d196e8369ab4c8&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:38.728054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06cc64-19cb-45b0-8f5b-7511f0e71c81 None admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:38.731775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:38.824045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06cc64-19cb-45b0-8f5b-7511f0e71c81 None admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:38.856966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cbe84-160c-42a3-80d1-0f94b5b00a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:38.857593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cbe84-160c-42a3-80d1-0f94b5b00a25 None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:38.857864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cbe84-160c-42a3-80d1-0f94b5b00a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:38.858130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cbe84-160c-42a3-80d1-0f94b5b00a25 None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:38.858725 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cbe84-160c-42a3-80d1-0f94b5b00a25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:38.860067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cbe84-160c-42a3-80d1-0f94b5b00a25 None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:38.866768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 484/978] 10.222.0.13 () {56 vars in 1087 bytes} [Wed Nov 2 07:17:38 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:17:40.985041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c1193-5769-4f59-98c8-387275535576 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:40.985548 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c1193-5769-4f59-98c8-387275535576 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:40.985641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c1193-5769-4f59-98c8-387275535576 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:40.986932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 495/979] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:17:40.992639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab74d-2d28-4cd8-b217-810cb802ff52 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:40.993085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab74d-2d28-4cd8-b217-810cb802ff52 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:40.993202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab74d-2d28-4cd8-b217-810cb802ff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:41.010715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5e3ab74d-2d28-4cd8-b217-810cb802ff52 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:17:41.011871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5e3ab74d-2d28-4cd8-b217-810cb802ff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:17:41.070013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:41.075635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 485/980] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:17:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:17:41.340598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c1193-5769-4f59-98c8-387275535576 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:41.359929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:41.440184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c1193-5769-4f59-98c8-387275535576 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:41.473703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63fd50-c35a-43b4-a16f-b9f3dd1b4ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:41.474307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63fd50-c35a-43b4-a16f-b9f3dd1b4ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:41.474761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63fd50-c35a-43b4-a16f-b9f3dd1b4ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:41.475036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63fd50-c35a-43b4-a16f-b9f3dd1b4ab6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:41.475602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63fd50-c35a-43b4-a16f-b9f3dd1b4ab6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:41.476952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63fd50-c35a-43b4-a16f-b9f3dd1b4ab6 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application [None req-0b63fd50-c35a-43b4-a16f-b9f3dd1b4ab6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:17:41.485429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:17:41.486643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application with Lock( Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: ERROR keystone.server.flask.application Nov 02 07:17:41.487979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 496/981] 10.222.0.13 () {56 vars in 1117 bytes} [Wed Nov 2 07:17:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:17:41.492967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ab74d-2d28-4cd8-b217-810cb802ff52 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:41.591748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ab74d-2d28-4cd8-b217-810cb802ff52 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:41.629310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb72ea-5421-419c-8700-1da7c5d5e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:41.629929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb72ea-5421-419c-8700-1da7c5d5e9aa None admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:41.630217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb72ea-5421-419c-8700-1da7c5d5e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:41.630482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb72ea-5421-419c-8700-1da7c5d5e9aa None admin] PATH_INFO: `/v3/services` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:41.631476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb72ea-5421-419c-8700-1da7c5d5e9aa None admin] RBAC: Adding query filter params (name=placement) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:17:41.631777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb72ea-5421-419c-8700-1da7c5d5e9aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:41.633175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb72ea-5421-419c-8700-1da7c5d5e9aa None admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:41.638371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 486/982] 10.222.0.13 () {56 vars in 1116 bytes} [Wed Nov 2 07:17:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:17:41.644178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63fd50-c35a-43b4-a16f-b9f3dd1b4ab6 None admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:17:41.722881 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:41.741790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63fd50-c35a-43b4-a16f-b9f3dd1b4ab6 None admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:17:41.773264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009c30d-271c-4598-b377-d8b2f5d72184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:17:41.773844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009c30d-271c-4598-b377-d8b2f5d72184 None admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:17:41.774114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009c30d-271c-4598-b377-d8b2f5d72184 None admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:17:41.774378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009c30d-271c-4598-b377-d8b2f5d72184 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:17:41.775031 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009c30d-271c-4598-b377-d8b2f5d72184 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:17:41.776372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009c30d-271c-4598-b377-d8b2f5d72184 None admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:17:41.795443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 497/983] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:17:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:17:51.635719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=69 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:17:51.791226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:18:46.195791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e9d7-198d-4f8e-a85c-fb8c6ee37a43 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:46.196861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e9d7-198d-4f8e-a85c-fb8c6ee37a43 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:46.197386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e9d7-198d-4f8e-a85c-fb8c6ee37a43 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:46.198952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 487/984] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:18:46.204248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f4f2-1186-4bba-ab43-adc8261a2847 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:46.204655 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f4f2-1186-4bba-ab43-adc8261a2847 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:46.204874 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f4f2-1186-4bba-ab43-adc8261a2847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:46.391859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0952f4f2-1186-4bba-ab43-adc8261a2847 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:18:46.393560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0952f4f2-1186-4bba-ab43-adc8261a2847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:46.577058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 498/985] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:18:46.897061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b98c5-a332-4e30-ab2a-01f570fde483 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:46.897953 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b98c5-a332-4e30-ab2a-01f570fde483 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:46.899419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b98c5-a332-4e30-ab2a-01f570fde483 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:46.901255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 488/986] 10.222.0.13 () {54 vars in 965 bytes} [Wed Nov 2 07:18:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:18:46.912604 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd89a1-dff3-4518-9b4c-d2d249677d36 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:46.914131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd89a1-dff3-4518-9b4c-d2d249677d36 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:46.914842 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd89a1-dff3-4518-9b4c-d2d249677d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:47.112672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0edd89a1-dff3-4518-9b4c-d2d249677d36 None None] MFA Rules not processed for user `7f1a24bf15594b12bbf59741fcb46cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:18:47.114565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0edd89a1-dff3-4518-9b4c-d2d249677d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:47.143238 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:18:47.220852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 499/987] 10.222.0.13 () {58 vars in 1062 bytes} [Wed Nov 2 07:18:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:18:47.230199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b98c5-a332-4e30-ab2a-01f570fde483 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:18:47.232028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-015b98c5-a332-4e30-ab2a-01f570fde483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:47.359006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b98c5-a332-4e30-ab2a-01f570fde483 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:18:47.439588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ad8e1-36f9-46a2-93c0-b58842d45221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:18:47.440123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ad8e1-36f9-46a2-93c0-b58842d45221 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:47.440397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ad8e1-36f9-46a2-93c0-b58842d45221 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:47.440664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ad8e1-36f9-46a2-93c0-b58842d45221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:47.442995 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-812ad8e1-36f9-46a2-93c0-b58842d45221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:47.510413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:18:47.587437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ad8e1-36f9-46a2-93c0-b58842d45221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:18:47.589122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ad8e1-36f9-46a2-93c0-b58842d45221 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:18:47.625763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 489/988] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:18:50.111034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b5412-643d-4c8a-996b-b031e3ecb26c None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:50.111571 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b5412-643d-4c8a-996b-b031e3ecb26c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:50.111728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b5412-643d-4c8a-996b-b031e3ecb26c None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:50.113169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 500/989] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:18:50.119868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129734f3-deb9-424f-8293-0debfcc19018 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:50.120411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129734f3-deb9-424f-8293-0debfcc19018 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:50.120411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129734f3-deb9-424f-8293-0debfcc19018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:50.193726 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-129734f3-deb9-424f-8293-0debfcc19018 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:18:50.194838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-129734f3-deb9-424f-8293-0debfcc19018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:50.290784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 490/990] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:18:50.575307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b5412-643d-4c8a-996b-b031e3ecb26c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:18:50.576828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-795b5412-643d-4c8a-996b-b031e3ecb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:50.680049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b5412-643d-4c8a-996b-b031e3ecb26c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:18:50.749859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:18:50.752039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe6dd0-29f5-46e2-9f05-c770e31ea843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:18:50.752858 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe6dd0-29f5-46e2-9f05-c770e31ea843 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:50.753228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe6dd0-29f5-46e2-9f05-c770e31ea843 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:50.753645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe6dd0-29f5-46e2-9f05-c770e31ea843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:50.756112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9abe6dd0-29f5-46e2-9f05-c770e31ea843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:50.862845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe6dd0-29f5-46e2-9f05-c770e31ea843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:18:50.864851 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe6dd0-29f5-46e2-9f05-c770e31ea843 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:18:50.884074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 501/991] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:18:53.319534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81156c34-f765-408f-ba62-7ef625388839 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:53.320068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81156c34-f765-408f-ba62-7ef625388839 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:53.320068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81156c34-f765-408f-ba62-7ef625388839 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:53.321447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 491/992] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:18:53.326736 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1661-bf20-49ff-958a-dee7578b51e5 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:53.327139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1661-bf20-49ff-958a-dee7578b51e5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:53.327276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d1661-bf20-49ff-958a-dee7578b51e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:53.392566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b96d1661-bf20-49ff-958a-dee7578b51e5 None None] MFA Rules not processed for user `7bf4a26de2df41a6a5813c08ab4c6bec`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:18:53.393802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b96d1661-bf20-49ff-958a-dee7578b51e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:53.445033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:18:53.489379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 502/993] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:18:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:18:53.787147 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67975a3-ddd4-4491-b64a-a455c4c5c4df None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:53.787425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67975a3-ddd4-4491-b64a-a455c4c5c4df None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:53.787728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67975a3-ddd4-4491-b64a-a455c4c5c4df None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:53.789082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 492/994] 10.222.0.13 () {54 vars in 965 bytes} [Wed Nov 2 07:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:18:53.794672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7853b-033a-47e7-92c6-bfb57a27518f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:53.794957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7853b-033a-47e7-92c6-bfb57a27518f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:53.795230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7853b-033a-47e7-92c6-bfb57a27518f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:53.871156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f7c7853b-033a-47e7-92c6-bfb57a27518f None None] MFA Rules not processed for user `7f1a24bf15594b12bbf59741fcb46cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:18:53.872367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f7c7853b-033a-47e7-92c6-bfb57a27518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:53.947428 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 503/995] 10.222.0.13 () {58 vars in 1062 bytes} [Wed Nov 2 07:18:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:18:53.956539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67975a3-ddd4-4491-b64a-a455c4c5c4df None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:18:53.966682 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e67975a3-ddd4-4491-b64a-a455c4c5c4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:53.977645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:18:54.068755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67975a3-ddd4-4491-b64a-a455c4c5c4df None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:18:54.140262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577168c-5ca7-4605-a8fb-f56768861a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:18:54.140855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577168c-5ca7-4605-a8fb-f56768861a83 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:54.141157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577168c-5ca7-4605-a8fb-f56768861a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:54.141423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577168c-5ca7-4605-a8fb-f56768861a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:54.142989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2577168c-5ca7-4605-a8fb-f56768861a83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:54.211578 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:18:54.257561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577168c-5ca7-4605-a8fb-f56768861a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:18:54.258979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577168c-5ca7-4605-a8fb-f56768861a83 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:18:54.276927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 493/996] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:18:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:18:57.444940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a892-b7e1-4aa9-864e-cb0e4aaf7d48 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:57.445494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a892-b7e1-4aa9-864e-cb0e4aaf7d48 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:57.445494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a892-b7e1-4aa9-864e-cb0e4aaf7d48 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:57.446850 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 504/997] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:18:57.452173 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff9357-8bd5-497c-ae48-2eac18631513 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:57.452561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff9357-8bd5-497c-ae48-2eac18631513 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:57.452717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff9357-8bd5-497c-ae48-2eac18631513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:57.516956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4fff9357-8bd5-497c-ae48-2eac18631513 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:18:57.518202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4fff9357-8bd5-497c-ae48-2eac18631513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:57.613258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 494/998] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:18:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:18:57.901676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7a892-b7e1-4aa9-864e-cb0e4aaf7d48 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:18:57.903197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f9c7a892-b7e1-4aa9-864e-cb0e4aaf7d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:57.952774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:18:58.006652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7a892-b7e1-4aa9-864e-cb0e4aaf7d48 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:18:58.080354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f8ddc-ef30-45ed-b8c9-ab6efda6c7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:18:58.080952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f8ddc-ef30-45ed-b8c9-ab6efda6c7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:18:58.081264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f8ddc-ef30-45ed-b8c9-ab6efda6c7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:18:58.081535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f8ddc-ef30-45ed-b8c9-ab6efda6c7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:18:58.083642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-034f8ddc-ef30-45ed-b8c9-ab6efda6c7d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:18:58.182091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:18:58.196642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f8ddc-ef30-45ed-b8c9-ab6efda6c7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:18:58.198105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f8ddc-ef30-45ed-b8c9-ab6efda6c7d4 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:18:58.216540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 505/999] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:18:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:01.136662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be2cce-62e1-4f71-bf77-12a469e0bc97 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:01.137250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be2cce-62e1-4f71-bf77-12a469e0bc97 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:01.137250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be2cce-62e1-4f71-bf77-12a469e0bc97 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:01.138596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 495/1000] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:01.144308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f87e-4949-4d62-a8ef-43acbe95e581 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:01.145420 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f87e-4949-4d62-a8ef-43acbe95e581 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:01.145775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f87e-4949-4d62-a8ef-43acbe95e581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:01.224393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1825f87e-4949-4d62-a8ef-43acbe95e581 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:01.225645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1825f87e-4949-4d62-a8ef-43acbe95e581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:01.323014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 506/1001] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:01.607599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be2cce-62e1-4f71-bf77-12a469e0bc97 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:01.609167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d8be2cce-62e1-4f71-bf77-12a469e0bc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:01.630125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:01.713320 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be2cce-62e1-4f71-bf77-12a469e0bc97 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:01.786221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade4b4a-1af3-4290-8206-1c4c964f000f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:01.786818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade4b4a-1af3-4290-8206-1c4c964f000f service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:01.787090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade4b4a-1af3-4290-8206-1c4c964f000f service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:01.787355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade4b4a-1af3-4290-8206-1c4c964f000f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:01.788926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aade4b4a-1af3-4290-8206-1c4c964f000f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:01.861851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:01.902006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade4b4a-1af3-4290-8206-1c4c964f000f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:01.903481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade4b4a-1af3-4290-8206-1c4c964f000f service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:01.921910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 496/1002] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:04.157571 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ecee0-e136-4c6a-9359-c33b0779b92f None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:04.158129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ecee0-e136-4c6a-9359-c33b0779b92f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:04.158129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ecee0-e136-4c6a-9359-c33b0779b92f None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:04.159359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 507/1003] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:04.165291 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd117c-4678-4df0-9c1c-00863ac387ba None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:04.165760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd117c-4678-4df0-9c1c-00863ac387ba None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:04.165846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd117c-4678-4df0-9c1c-00863ac387ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:04.237700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ebfd117c-4678-4df0-9c1c-00863ac387ba None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:04.239298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ebfd117c-4678-4df0-9c1c-00863ac387ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:04.335353 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 497/1004] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:04.616929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ecee0-e136-4c6a-9359-c33b0779b92f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:04.618574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-897ecee0-e136-4c6a-9359-c33b0779b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:04.679533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:04.723622 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ecee0-e136-4c6a-9359-c33b0779b92f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:04.798279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fda390-ebfb-41c1-9d78-fc641a2b75d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:04.798881 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fda390-ebfb-41c1-9d78-fc641a2b75d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:04.799156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fda390-ebfb-41c1-9d78-fc641a2b75d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:04.799422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fda390-ebfb-41c1-9d78-fc641a2b75d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:04.801260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f4fda390-ebfb-41c1-9d78-fc641a2b75d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:04.911643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:04.914047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fda390-ebfb-41c1-9d78-fc641a2b75d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:04.915656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fda390-ebfb-41c1-9d78-fc641a2b75d6 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:04.934711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 508/1005] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:07.132909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bd3ed-6169-4aac-a7e9-c7a7e609f503 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:07.133444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bd3ed-6169-4aac-a7e9-c7a7e609f503 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:07.133444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bd3ed-6169-4aac-a7e9-c7a7e609f503 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:07.134764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 498/1006] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:07.139873 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4605-1ac6-4faa-952d-0542a727c246 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:07.140316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4605-1ac6-4faa-952d-0542a727c246 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:07.140417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4605-1ac6-4faa-952d-0542a727c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:07.206848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e77a4605-1ac6-4faa-952d-0542a727c246 None None] MFA Rules not processed for user `7bf4a26de2df41a6a5813c08ab4c6bec`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:07.208666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e77a4605-1ac6-4faa-952d-0542a727c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:07.305696 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 509/1007] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:07.590150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bd3ed-6169-4aac-a7e9-c7a7e609f503 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:07.591659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b97bd3ed-6169-4aac-a7e9-c7a7e609f503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:07.623471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:07.697501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bd3ed-6169-4aac-a7e9-c7a7e609f503 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:07.771604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bc21a-abf3-497c-8821-4f3c63ff9d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:07.772207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc21a-abf3-497c-8821-4f3c63ff9d94 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:07.772485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc21a-abf3-497c-8821-4f3c63ff9d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:07.772761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bc21a-abf3-497c-8821-4f3c63ff9d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:07.774380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-880bc21a-abf3-497c-8821-4f3c63ff9d94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:07.854111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:07.887454 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bc21a-abf3-497c-8821-4f3c63ff9d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:07.888884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bc21a-abf3-497c-8821-4f3c63ff9d94 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:07.907705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 499/1008] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:19:10.289899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8200a8e-141c-4eed-81d9-119e644c66d4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:10.290417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8200a8e-141c-4eed-81d9-119e644c66d4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:10.290417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8200a8e-141c-4eed-81d9-119e644c66d4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:10.291696 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 510/1009] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:10.296852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596a85-a77c-4a1f-8eb4-9a5de7e3ed7f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:10.297338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596a85-a77c-4a1f-8eb4-9a5de7e3ed7f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:10.297440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596a85-a77c-4a1f-8eb4-9a5de7e3ed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:10.364128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-93596a85-a77c-4a1f-8eb4-9a5de7e3ed7f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:10.365471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-93596a85-a77c-4a1f-8eb4-9a5de7e3ed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:10.458861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 500/1010] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:10.740179 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8200a8e-141c-4eed-81d9-119e644c66d4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:10.741741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f8200a8e-141c-4eed-81d9-119e644c66d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:10.810727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:10.844156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8200a8e-141c-4eed-81d9-119e644c66d4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:10.918589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690260f-96e9-40c0-aa3b-a187b135e90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:10.919220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690260f-96e9-40c0-aa3b-a187b135e90a service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:10.919495 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690260f-96e9-40c0-aa3b-a187b135e90a service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:10.919764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690260f-96e9-40c0-aa3b-a187b135e90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:10.921391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1690260f-96e9-40c0-aa3b-a187b135e90a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:11.030402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690260f-96e9-40c0-aa3b-a187b135e90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:11.031742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690260f-96e9-40c0-aa3b-a187b135e90a service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:11.041990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:11.050294 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 511/1011] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:13.250239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7acea0-c8ab-4349-afb1-60f12a8c111b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:13.250743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7acea0-c8ab-4349-afb1-60f12a8c111b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:13.250743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7acea0-c8ab-4349-afb1-60f12a8c111b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:13.252040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 501/1012] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:13.257494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58232-0856-49c8-bf1b-5eb2e82c4306 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:13.257916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58232-0856-49c8-bf1b-5eb2e82c4306 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:13.258037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58232-0856-49c8-bf1b-5eb2e82c4306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:13.323367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-dbd58232-0856-49c8-bf1b-5eb2e82c4306 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:13.324570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dbd58232-0856-49c8-bf1b-5eb2e82c4306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:13.419805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 512/1013] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:13.705082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7acea0-c8ab-4349-afb1-60f12a8c111b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:13.706618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3b7acea0-c8ab-4349-afb1-60f12a8c111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:13.746565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:13.809393 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7acea0-c8ab-4349-afb1-60f12a8c111b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:13.881906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c913be6-ccdd-4337-8179-8ed201710931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:13.882508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c913be6-ccdd-4337-8179-8ed201710931 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:13.882784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c913be6-ccdd-4337-8179-8ed201710931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:13.883054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c913be6-ccdd-4337-8179-8ed201710931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:13.884639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5c913be6-ccdd-4337-8179-8ed201710931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:13.967990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:13.994955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c913be6-ccdd-4337-8179-8ed201710931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:13.996380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c913be6-ccdd-4337-8179-8ed201710931 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:14.013803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 502/1014] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:16.475982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683b5c8-02d6-409d-b25a-91e60d70bd73 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:16.476508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683b5c8-02d6-409d-b25a-91e60d70bd73 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:16.476508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683b5c8-02d6-409d-b25a-91e60d70bd73 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:16.477879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 513/1015] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:16.483003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1080de-f555-4c7b-81e5-82757a3f0965 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:16.483402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1080de-f555-4c7b-81e5-82757a3f0965 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:16.483538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1080de-f555-4c7b-81e5-82757a3f0965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:16.548711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8f1080de-f555-4c7b-81e5-82757a3f0965 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:16.549927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8f1080de-f555-4c7b-81e5-82757a3f0965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:16.648230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 503/1016] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:19:16.928499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683b5c8-02d6-409d-b25a-91e60d70bd73 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:16.930051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f683b5c8-02d6-409d-b25a-91e60d70bd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:17.006778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:17.037187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683b5c8-02d6-409d-b25a-91e60d70bd73 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:17.110880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457cf13-c22b-4ea4-abde-cac6865aa738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:17.111476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457cf13-c22b-4ea4-abde-cac6865aa738 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:17.111745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457cf13-c22b-4ea4-abde-cac6865aa738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:17.112020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457cf13-c22b-4ea4-abde-cac6865aa738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:17.114548 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d457cf13-c22b-4ea4-abde-cac6865aa738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:17.219720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457cf13-c22b-4ea4-abde-cac6865aa738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:17.221094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457cf13-c22b-4ea4-abde-cac6865aa738 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:17.239660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 514/1017] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:21.377168 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406de60-e066-4e3c-bded-442ecb946ebe None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:21.377689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406de60-e066-4e3c-bded-442ecb946ebe None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:21.377689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406de60-e066-4e3c-bded-442ecb946ebe None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:21.379011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 504/1018] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:21.384498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9f01-fb25-47e6-b174-6bed72b9d75f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:21.384912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9f01-fb25-47e6-b174-6bed72b9d75f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:21.385073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd9f01-fb25-47e6-b174-6bed72b9d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:21.390529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:21.452970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-33fd9f01-fb25-47e6-b174-6bed72b9d75f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:21.454111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-33fd9f01-fb25-47e6-b174-6bed72b9d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:21.551747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 515/1019] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:21.835963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406de60-e066-4e3c-bded-442ecb946ebe None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:21.837520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6406de60-e066-4e3c-bded-442ecb946ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:21.886454 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:21.946995 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406de60-e066-4e3c-bded-442ecb946ebe None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:22.023045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1f233-e42d-41d6-befa-d1cf10cccfa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:22.023642 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1f233-e42d-41d6-befa-d1cf10cccfa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:22.023917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1f233-e42d-41d6-befa-d1cf10cccfa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:22.024182 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1f233-e42d-41d6-befa-d1cf10cccfa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:22.025795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-10e1f233-e42d-41d6-befa-d1cf10cccfa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:22.119109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:22.136375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1f233-e42d-41d6-befa-d1cf10cccfa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:22.137837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1f233-e42d-41d6-befa-d1cf10cccfa5 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:22.156633 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 505/1020] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:24.973597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda1ea6-d584-4e95-8f0c-d29f73e18b97 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:24.974107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda1ea6-d584-4e95-8f0c-d29f73e18b97 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:24.974107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda1ea6-d584-4e95-8f0c-d29f73e18b97 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:24.975448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 516/1021] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:24.980586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690559d-c0bd-48f9-bd84-2a3995a3162a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:24.981060 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690559d-c0bd-48f9-bd84-2a3995a3162a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:24.981170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690559d-c0bd-48f9-bd84-2a3995a3162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:25.049303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6690559d-c0bd-48f9-bd84-2a3995a3162a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:25.050607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6690559d-c0bd-48f9-bd84-2a3995a3162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:25.152679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 506/1022] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:25.451591 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda1ea6-d584-4e95-8f0c-d29f73e18b97 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:25.453130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ebda1ea6-d584-4e95-8f0c-d29f73e18b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:25.546808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:25.564917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda1ea6-d584-4e95-8f0c-d29f73e18b97 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:25.646072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1a21-7988-4839-b800-0777f972fdfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:25.646593 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1a21-7988-4839-b800-0777f972fdfe service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:25.646872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1a21-7988-4839-b800-0777f972fdfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:25.647263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1a21-7988-4839-b800-0777f972fdfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:25.648871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-171f1a21-7988-4839-b800-0777f972fdfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:25.759991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f1a21-7988-4839-b800-0777f972fdfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:25.761463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f1a21-7988-4839-b800-0777f972fdfe service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:25.779190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 517/1023] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:29.899978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5834c2-975b-4683-8599-8d7125e7e642 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:29.900440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5834c2-975b-4683-8599-8d7125e7e642 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:29.900517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5834c2-975b-4683-8599-8d7125e7e642 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:29.905213 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 507/1024] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:29.907348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63764d7b-959d-4ecd-a051-02a1648ec424 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:29.907793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63764d7b-959d-4ecd-a051-02a1648ec424 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:29.907946 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63764d7b-959d-4ecd-a051-02a1648ec424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:29.923827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:29.978229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-63764d7b-959d-4ecd-a051-02a1648ec424 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:29.979447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-63764d7b-959d-4ecd-a051-02a1648ec424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:30.082239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 518/1025] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:30.364200 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5834c2-975b-4683-8599-8d7125e7e642 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:30.365760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dd5834c2-975b-4683-8599-8d7125e7e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:30.429708 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:30.478927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5834c2-975b-4683-8599-8d7125e7e642 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:30.554317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb82e15-660f-42e0-b5f1-c836ae75bbd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:30.554920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb82e15-660f-42e0-b5f1-c836ae75bbd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:30.555190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb82e15-660f-42e0-b5f1-c836ae75bbd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:30.555456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb82e15-660f-42e0-b5f1-c836ae75bbd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:30.557097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0eb82e15-660f-42e0-b5f1-c836ae75bbd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:30.669873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:30.674411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb82e15-660f-42e0-b5f1-c836ae75bbd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:30.676448 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb82e15-660f-42e0-b5f1-c836ae75bbd0 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:30.695162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 508/1026] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:35.698055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547cd6e-0d0f-457f-8c4d-b8e36d9da5f9 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:35.698543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547cd6e-0d0f-457f-8c4d-b8e36d9da5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:35.698630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547cd6e-0d0f-457f-8c4d-b8e36d9da5f9 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:35.700076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 519/1027] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:35.705566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947a8ca-f08b-418d-a1cb-bc27431e8ace None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:35.706006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947a8ca-f08b-418d-a1cb-bc27431e8ace None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:35.706158 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947a8ca-f08b-418d-a1cb-bc27431e8ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:35.803218 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a947a8ca-f08b-418d-a1cb-bc27431e8ace None None] MFA Rules not processed for user `55214b594a3f42ff8a7e0cecdef98937`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:35.804411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a947a8ca-f08b-418d-a1cb-bc27431e8ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:35.965302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 509/1028] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:19:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:40.080602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=59 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:40.232539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092575-dbd5-45bf-bb30-25512324b9b6 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:40.232716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092575-dbd5-45bf-bb30-25512324b9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:40.232985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092575-dbd5-45bf-bb30-25512324b9b6 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:40.234602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 520/1029] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:40.241260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bc126-8dbe-427d-a63a-07b90206b389 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:40.241711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bc126-8dbe-427d-a63a-07b90206b389 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:40.241887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bc126-8dbe-427d-a63a-07b90206b389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:40.300595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:40.325531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e14bc126-8dbe-427d-a63a-07b90206b389 None None] MFA Rules not processed for user `55214b594a3f42ff8a7e0cecdef98937`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:40.326978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e14bc126-8dbe-427d-a63a-07b90206b389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:40.445182 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 510/1030] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:19:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:41.848138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6828a4-b7e4-4a31-867e-e6ff11384121 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:41.848665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6828a4-b7e4-4a31-867e-e6ff11384121 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:41.848907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6828a4-b7e4-4a31-867e-e6ff11384121 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:41.850297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 521/1031] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:41.855495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34f70-2385-4b03-a030-fce774ea93a4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:41.855894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34f70-2385-4b03-a030-fce774ea93a4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:41.856032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa34f70-2385-4b03-a030-fce774ea93a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:41.935302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9aa34f70-2385-4b03-a030-fce774ea93a4 None None] MFA Rules not processed for user `55214b594a3f42ff8a7e0cecdef98937`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:41.936495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9aa34f70-2385-4b03-a030-fce774ea93a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:41.980489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:42.044806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 511/1032] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:19:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:19:45.640143 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacb888-1e99-4283-a043-d6d85f89ccab None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:45.640694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacb888-1e99-4283-a043-d6d85f89ccab None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:45.640694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacb888-1e99-4283-a043-d6d85f89ccab None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:45.642199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 522/1033] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:45.649234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f25eb-78fc-4d24-99ce-0cd9b0c9f714 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:45.649684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f25eb-78fc-4d24-99ce-0cd9b0c9f714 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:45.649774 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f25eb-78fc-4d24-99ce-0cd9b0c9f714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:45.719184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-341f25eb-78fc-4d24-99ce-0cd9b0c9f714 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:45.720354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-341f25eb-78fc-4d24-99ce-0cd9b0c9f714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:45.828753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 512/1034] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:46.127767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009b4eb-adbb-46c6-9bd7-ea0c7cfc81e4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:46.129033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009b4eb-adbb-46c6-9bd7-ea0c7cfc81e4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:46.129586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009b4eb-adbb-46c6-9bd7-ea0c7cfc81e4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:46.131191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 523/1035] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 07:19:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:46.139301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9be04e-5d1d-4272-95ac-ac3a23e6e09e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:46.139578 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9be04e-5d1d-4272-95ac-ac3a23e6e09e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:46.139852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9be04e-5d1d-4272-95ac-ac3a23e6e09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:46.156224 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:46.220466 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cb9be04e-5d1d-4272-95ac-ac3a23e6e09e None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:46.222884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cb9be04e-5d1d-4272-95ac-ac3a23e6e09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:46.349057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 513/1036] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 07:19:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:46.357293 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009b4eb-adbb-46c6-9bd7-ea0c7cfc81e4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:46.359070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8009b4eb-adbb-46c6-9bd7-ea0c7cfc81e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:46.527360 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009b4eb-adbb-46c6-9bd7-ea0c7cfc81e4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:46.607544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:46.652474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb85117-b869-4461-9931-2379bf69ccac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:46.653162 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb85117-b869-4461-9931-2379bf69ccac service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:46.653455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb85117-b869-4461-9931-2379bf69ccac service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:46.653678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb85117-b869-4461-9931-2379bf69ccac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:46.655325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-aeb85117-b869-4461-9931-2379bf69ccac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:46.763979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb85117-b869-4461-9931-2379bf69ccac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:46.765968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb85117-b869-4461-9931-2379bf69ccac service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:46.786036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 524/1037] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:49.187657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f79bbb-96d3-4426-997d-6679f0abe317 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:49.188395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f79bbb-96d3-4426-997d-6679f0abe317 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:49.188395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f79bbb-96d3-4426-997d-6679f0abe317 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:49.189731 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 514/1038] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:49.195256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876685-6776-460d-9106-e4a22c9103d9 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:49.195702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876685-6776-460d-9106-e4a22c9103d9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:49.195786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a876685-6776-460d-9106-e4a22c9103d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:49.271501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6a876685-6776-460d-9106-e4a22c9103d9 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:49.272826 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6a876685-6776-460d-9106-e4a22c9103d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:49.312926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:49.379630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 525/1039] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:49.667206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f79bbb-96d3-4426-997d-6679f0abe317 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:49.668988 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e6f79bbb-96d3-4426-997d-6679f0abe317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:49.756445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:49.863932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f79bbb-96d3-4426-997d-6679f0abe317 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:49.992741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47187f64-72ff-4146-ab9e-27a7b08ba95a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:49.993408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47187f64-72ff-4146-ab9e-27a7b08ba95a service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:49.993683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47187f64-72ff-4146-ab9e-27a7b08ba95a service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:49.993948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47187f64-72ff-4146-ab9e-27a7b08ba95a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:49.995534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-47187f64-72ff-4146-ab9e-27a7b08ba95a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:50.020757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:50.089891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47187f64-72ff-4146-ab9e-27a7b08ba95a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:50.091468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47187f64-72ff-4146-ab9e-27a7b08ba95a service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:50.110103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 515/1040] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:52.622592 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89c5f6-0421-425a-9fa9-3c9c20172706 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:52.623179 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89c5f6-0421-425a-9fa9-3c9c20172706 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:52.623179 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89c5f6-0421-425a-9fa9-3c9c20172706 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:52.624704 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 526/1041] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:52.629977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6457f9-b03f-45b7-8abe-26b04c32cbc1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:52.630390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6457f9-b03f-45b7-8abe-26b04c32cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:52.630487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6457f9-b03f-45b7-8abe-26b04c32cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:52.699208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-de6457f9-b03f-45b7-8abe-26b04c32cbc1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:52.700382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-de6457f9-b03f-45b7-8abe-26b04c32cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:52.801086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:52.809365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 516/1042] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:53.091698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30d244-9083-4c62-b7da-cd096af11c0a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:53.092095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30d244-9083-4c62-b7da-cd096af11c0a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:53.092472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30d244-9083-4c62-b7da-cd096af11c0a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:53.094059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 527/1043] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 07:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:53.101746 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273509bf-f0b9-4a98-aea5-a4c93d795ddf None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:53.102028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273509bf-f0b9-4a98-aea5-a4c93d795ddf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:53.102298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273509bf-f0b9-4a98-aea5-a4c93d795ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:53.182958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-273509bf-f0b9-4a98-aea5-a4c93d795ddf None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:53.184041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-273509bf-f0b9-4a98-aea5-a4c93d795ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:53.304230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 517/1044] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 07:19:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:53.312345 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30d244-9083-4c62-b7da-cd096af11c0a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:53.314010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8f30d244-9083-4c62-b7da-cd096af11c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:53.472324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30d244-9083-4c62-b7da-cd096af11c0a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:53.494196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:53.594199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622ead5-f502-4380-aabb-a677e15c0dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:53.594797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622ead5-f502-4380-aabb-a677e15c0dc8 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:53.595095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622ead5-f502-4380-aabb-a677e15c0dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:53.595362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622ead5-f502-4380-aabb-a677e15c0dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:53.597354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2622ead5-f502-4380-aabb-a677e15c0dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:53.697992 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622ead5-f502-4380-aabb-a677e15c0dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:53.699573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622ead5-f502-4380-aabb-a677e15c0dc8 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:53.719833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 528/1045] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:19:53.755524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffddb10-12e6-4472-9298-7b2d24b4441d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:53.756081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffddb10-12e6-4472-9298-7b2d24b4441d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:53.756081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffddb10-12e6-4472-9298-7b2d24b4441d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:53.757445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 518/1046] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:19:53.762904 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83960240-4b99-4d83-8f67-fc1a95a6b95f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:53.763184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83960240-4b99-4d83-8f67-fc1a95a6b95f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:53.763459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83960240-4b99-4d83-8f67-fc1a95a6b95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:53.801286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:53.852320 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-83960240-4b99-4d83-8f67-fc1a95a6b95f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:53.853991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-83960240-4b99-4d83-8f67-fc1a95a6b95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:53.985178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 529/1047] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:54.316999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59499ab-7afc-4f67-8a25-c0d5f04e840e None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:54.316999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59499ab-7afc-4f67-8a25-c0d5f04e840e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:54.316999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59499ab-7afc-4f67-8a25-c0d5f04e840e None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:54.318216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 519/1048] 10.222.0.13 () {54 vars in 963 bytes} [Wed Nov 2 07:19:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:54.323054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fb816-69bd-4d80-a0cb-284e7580a3b8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:54.323443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fb816-69bd-4d80-a0cb-284e7580a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:54.323815 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fb816-69bd-4d80-a0cb-284e7580a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:54.405700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-280fb816-69bd-4d80-a0cb-284e7580a3b8 None None] MFA Rules not processed for user `2972059254094f8e909eb2adbb0b2257`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:54.407036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-280fb816-69bd-4d80-a0cb-284e7580a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:54.459757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:54.492327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 530/1049] 10.222.0.13 () {58 vars in 1060 bytes} [Wed Nov 2 07:19:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:54.499973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59499ab-7afc-4f67-8a25-c0d5f04e840e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:54.501631 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d59499ab-7afc-4f67-8a25-c0d5f04e840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:54.557331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:54.617527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59499ab-7afc-4f67-8a25-c0d5f04e840e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:54.714043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719e433-754c-4510-8b47-041981e332a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:54.714860 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719e433-754c-4510-8b47-041981e332a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:54.715270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719e433-754c-4510-8b47-041981e332a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:54.715772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719e433-754c-4510-8b47-041981e332a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:54.717991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b719e433-754c-4510-8b47-041981e332a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:54.867215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:54.900241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719e433-754c-4510-8b47-041981e332a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:54.901852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719e433-754c-4510-8b47-041981e332a2 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:54.930877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 520/1050] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:55.981465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2221c-1c93-4745-9406-d43b58b4f34f None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:55.982021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2221c-1c93-4745-9406-d43b58b4f34f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:55.982021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2221c-1c93-4745-9406-d43b58b4f34f None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:55.983412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 531/1051] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:55.989912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3618c9-15d9-4107-acd6-04b3f68b1264 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:55.990388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3618c9-15d9-4107-acd6-04b3f68b1264 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:55.990599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3618c9-15d9-4107-acd6-04b3f68b1264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:56.059463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ed3618c9-15d9-4107-acd6-04b3f68b1264 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:56.060658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ed3618c9-15d9-4107-acd6-04b3f68b1264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:56.156349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 521/1052] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:56.450233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2221c-1c93-4745-9406-d43b58b4f34f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:56.451754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-daa2221c-1c93-4745-9406-d43b58b4f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:56.616296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2221c-1c93-4745-9406-d43b58b4f34f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:19:56.669530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:56.734886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbcdc6-b862-4635-8526-e06fbbf5716d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:19:56.735488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbcdc6-b862-4635-8526-e06fbbf5716d service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:56.735760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbcdc6-b862-4635-8526-e06fbbf5716d service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:56.736020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbcdc6-b862-4635-8526-e06fbbf5716d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:56.738369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-80bbcdc6-b862-4635-8526-e06fbbf5716d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:56.833759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbcdc6-b862-4635-8526-e06fbbf5716d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:19:56.835352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbcdc6-b862-4635-8526-e06fbbf5716d service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:19:56.856579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 532/1053] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:19:59.263867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825a654-dfd7-4a80-8493-2f3f18e12a7b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:59.264414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825a654-dfd7-4a80-8493-2f3f18e12a7b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:59.264414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825a654-dfd7-4a80-8493-2f3f18e12a7b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:59.269053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 522/1054] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:19:59.271962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395d738-f6bb-4081-a27e-2c61467215d9 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:19:59.272412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395d738-f6bb-4081-a27e-2c61467215d9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:19:59.272518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395d738-f6bb-4081-a27e-2c61467215d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:19:59.344305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f395d738-f6bb-4081-a27e-2c61467215d9 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:19:59.345585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f395d738-f6bb-4081-a27e-2c61467215d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:59.355493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:59.457158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 533/1055] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:19:59.757326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825a654-dfd7-4a80-8493-2f3f18e12a7b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:19:59.759001 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5825a654-dfd7-4a80-8493-2f3f18e12a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:19:59.823605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:19:59.917676 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825a654-dfd7-4a80-8493-2f3f18e12a7b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:00.040648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca41a3-5b9f-4bf5-b603-b59dc3793564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:00.041189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca41a3-5b9f-4bf5-b603-b59dc3793564 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:00.041462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca41a3-5b9f-4bf5-b603-b59dc3793564 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:00.041728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca41a3-5b9f-4bf5-b603-b59dc3793564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:00.043280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-adca41a3-5b9f-4bf5-b603-b59dc3793564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:00.063617 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:00.141469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca41a3-5b9f-4bf5-b603-b59dc3793564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:00.143040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca41a3-5b9f-4bf5-b603-b59dc3793564 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:00.162144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 523/1056] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:02.388027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46078cbc-0dc0-4dc9-9f33-f06e7aef8c17 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:02.388516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46078cbc-0dc0-4dc9-9f33-f06e7aef8c17 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:02.388608 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46078cbc-0dc0-4dc9-9f33-f06e7aef8c17 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:02.389935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 534/1057] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:02.395468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda6b3-709f-4577-b596-188a35a9a58d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:02.395900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda6b3-709f-4577-b596-188a35a9a58d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:02.396008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda6b3-709f-4577-b596-188a35a9a58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:02.513184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-23cda6b3-709f-4577-b596-188a35a9a58d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:02.516165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-23cda6b3-709f-4577-b596-188a35a9a58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:02.623819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:02.632214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 524/1058] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:02.925808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46078cbc-0dc0-4dc9-9f33-f06e7aef8c17 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:02.927437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-46078cbc-0dc0-4dc9-9f33-f06e7aef8c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:03.072199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:03.085644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46078cbc-0dc0-4dc9-9f33-f06e7aef8c17 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:03.211892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84de18-0f73-431c-a339-1bee9a277b68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:03.212433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84de18-0f73-431c-a339-1bee9a277b68 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:03.212722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84de18-0f73-431c-a339-1bee9a277b68 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:03.213000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84de18-0f73-431c-a339-1bee9a277b68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:03.214673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ca84de18-0f73-431c-a339-1bee9a277b68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:03.307446 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84de18-0f73-431c-a339-1bee9a277b68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:03.309026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84de18-0f73-431c-a339-1bee9a277b68 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:03.319536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:03.328746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 535/1059] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:06.542872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4e6a2-671f-4394-b481-badacdf1c90b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:06.543461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4e6a2-671f-4394-b481-badacdf1c90b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:06.543567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4e6a2-671f-4394-b481-badacdf1c90b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:06.545450 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 525/1060] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:06.551435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148217d2-3c9d-425f-8d60-92a09aa481c7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:06.551871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148217d2-3c9d-425f-8d60-92a09aa481c7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:06.552025 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148217d2-3c9d-425f-8d60-92a09aa481c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:06.625631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-148217d2-3c9d-425f-8d60-92a09aa481c7 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:06.627020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-148217d2-3c9d-425f-8d60-92a09aa481c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:06.731382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 536/1061] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:20:07.020487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4e6a2-671f-4394-b481-badacdf1c90b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:07.022006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b3c4e6a2-671f-4394-b481-badacdf1c90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:07.183211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4e6a2-671f-4394-b481-badacdf1c90b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:07.255545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:07.309911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079ee0a-eb61-4b1d-9833-da12ffebb887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:07.310566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079ee0a-eb61-4b1d-9833-da12ffebb887 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:07.311195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079ee0a-eb61-4b1d-9833-da12ffebb887 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:07.311722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079ee0a-eb61-4b1d-9833-da12ffebb887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:07.313785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c079ee0a-eb61-4b1d-9833-da12ffebb887 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:07.419018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079ee0a-eb61-4b1d-9833-da12ffebb887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:07.422960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079ee0a-eb61-4b1d-9833-da12ffebb887 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:07.456707 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 526/1062] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:20:09.692840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc105-423d-4060-90fb-572f356ef7c2 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:09.693459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc105-423d-4060-90fb-572f356ef7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:09.693459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc105-423d-4060-90fb-572f356ef7c2 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:09.694875 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 537/1063] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:09.699983 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f539-c073-40aa-a3a9-ad27a2c7a270 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:09.700388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f539-c073-40aa-a3a9-ad27a2c7a270 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:09.700521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76f539-c073-40aa-a3a9-ad27a2c7a270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:09.767285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cd76f539-c073-40aa-a3a9-ad27a2c7a270 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:09.769042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cd76f539-c073-40aa-a3a9-ad27a2c7a270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:09.802626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:09.867632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 527/1064] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:10.154623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc105-423d-4060-90fb-572f356ef7c2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:10.156129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-42bcc105-423d-4060-90fb-572f356ef7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:10.233716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:10.305077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc105-423d-4060-90fb-572f356ef7c2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:10.424933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e643a4-30c9-431b-bc58-17ea42ef35c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:10.425474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e643a4-30c9-431b-bc58-17ea42ef35c2 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:10.425746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e643a4-30c9-431b-bc58-17ea42ef35c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:10.426033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e643a4-30c9-431b-bc58-17ea42ef35c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:10.427753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b0e643a4-30c9-431b-bc58-17ea42ef35c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:10.473954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:10.481437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33ca1-3033-42dd-b02b-9be4783ba343 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:10.481716 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33ca1-3033-42dd-b02b-9be4783ba343 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:10.481983 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33ca1-3033-42dd-b02b-9be4783ba343 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:10.483641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 528/1065] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:10.488849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32e52c-91a9-48f3-85ad-db6464561db3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:10.489183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32e52c-91a9-48f3-85ad-db6464561db3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:10.489480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32e52c-91a9-48f3-85ad-db6464561db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:10.529529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e643a4-30c9-431b-bc58-17ea42ef35c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:10.531120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e643a4-30c9-431b-bc58-17ea42ef35c2 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:10.550113 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 538/1066] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:10.556916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2b32e52c-91a9-48f3-85ad-db6464561db3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:10.558149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2b32e52c-91a9-48f3-85ad-db6464561db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:10.667919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 529/1067] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:20:10.973584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476ce16-8183-47b6-92c5-d38f97cefd80 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:10.974058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476ce16-8183-47b6-92c5-d38f97cefd80 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:10.974173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476ce16-8183-47b6-92c5-d38f97cefd80 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:10.975482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 539/1068] 10.222.0.13 () {54 vars in 962 bytes} [Wed Nov 2 07:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:10.980762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb696c-deb9-467b-a9f9-e19ab02c189c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:10.981222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb696c-deb9-467b-a9f9-e19ab02c189c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:10.981440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb696c-deb9-467b-a9f9-e19ab02c189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:10.997376 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:11.058495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5aeb696c-deb9-467b-a9f9-e19ab02c189c None None] MFA Rules not processed for user `c27a93c04181493593a069650a977773`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:11.059693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5aeb696c-deb9-467b-a9f9-e19ab02c189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:11.135705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 530/1069] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Nov 2 07:20:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:20:11.144246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476ce16-8183-47b6-92c5-d38f97cefd80 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:11.145754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0476ce16-8183-47b6-92c5-d38f97cefd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:11.248440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476ce16-8183-47b6-92c5-d38f97cefd80 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:11.310400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:11.327422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5b3cd-9a3f-432a-8679-e0ece58e157f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27a93c04181493593a069650a977773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:11.328032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5b3cd-9a3f-432a-8679-e0ece58e157f service glance] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:11.328310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5b3cd-9a3f-432a-8679-e0ece58e157f service glance] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:11.328580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5b3cd-9a3f-432a-8679-e0ece58e157f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:11.330205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b7b5b3cd-9a3f-432a-8679-e0ece58e157f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:11.446463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5b3cd-9a3f-432a-8679-e0ece58e157f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:11.447922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5b3cd-9a3f-432a-8679-e0ece58e157f service glance] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:11.466350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 540/1070] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:20:12.212538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624cae-1e17-4805-b86f-33b20f09c7b9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:12.213073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624cae-1e17-4805-b86f-33b20f09c7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:12.213179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624cae-1e17-4805-b86f-33b20f09c7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:12.282316 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f9624cae-1e17-4805-b86f-33b20f09c7b9 None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:12.283526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f9624cae-1e17-4805-b86f-33b20f09c7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:12.341428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:12.373318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 531/1071] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:20:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:12.419816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81488-c156-4303-83d7-4c2c55a6f8d7 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:12.420276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81488-c156-4303-83d7-4c2c55a6f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:12.420407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81488-c156-4303-83d7-4c2c55a6f8d7 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:12.421792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 541/1072] 10.222.0.13 () {54 vars in 943 bytes} [Wed Nov 2 07:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:12.429697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22907-f168-4095-ae59-cf4045d10214 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:12.430055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22907-f168-4095-ae59-cf4045d10214 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:12.430639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22907-f168-4095-ae59-cf4045d10214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:12.508366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c0c22907-f168-4095-ae59-cf4045d10214 None None] MFA Rules not processed for user `d80d3e8c42ab4942b32618db3f19dd88`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:12.509598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c0c22907-f168-4095-ae59-cf4045d10214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:12.618431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 532/1073] 10.222.0.13 () {58 vars in 1040 bytes} [Wed Nov 2 07:20:12 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:12.628168 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81488-c156-4303-83d7-4c2c55a6f8d7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:12.629742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0cb81488-c156-4303-83d7-4c2c55a6f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:12.724192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:12.757680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f79d3-0b10-46a8-8e2e-4a12c0a7c5d2 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:12.757960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f79d3-0b10-46a8-8e2e-4a12c0a7c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:12.758225 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f79d3-0b10-46a8-8e2e-4a12c0a7c5d2 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:12.759560 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 533/1074] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:20:12.764756 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e8b11-e84b-42af-bbb4-6715efe032f4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:12.765056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e8b11-e84b-42af-bbb4-6715efe032f4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:12.765331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e8b11-e84b-42af-bbb4-6715efe032f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:12.775414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81488-c156-4303-83d7-4c2c55a6f8d7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:12.803467 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:12.835371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-811e8b11-e84b-42af-bbb4-6715efe032f4 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:12.836572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-811e8b11-e84b-42af-bbb4-6715efe032f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:12.883765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175bd3e-eaa8-4f43-a713-859b00e4a558 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:12.884375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bd3e-eaa8-4f43-a713-859b00e4a558 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:12.884655 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bd3e-eaa8-4f43-a713-859b00e4a558 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:12.884929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bd3e-eaa8-4f43-a713-859b00e4a558 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:12.886602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1175bd3e-eaa8-4f43-a713-859b00e4a558 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:12.940464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 534/1075] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:20:12.961980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:12.974484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175bd3e-eaa8-4f43-a713-859b00e4a558 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:12.975993 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175bd3e-eaa8-4f43-a713-859b00e4a558 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:12.983924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 542/1076] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:20:13.245052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e8b11-e84b-42af-bbb4-6715efe032f4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:13.246776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-811e8b11-e84b-42af-bbb4-6715efe032f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:13.371168 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:13.375835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e8b11-e84b-42af-bbb4-6715efe032f4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:13.506147 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b995d-7828-48b9-9bb3-7710e2ba05a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:13.506674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b995d-7828-48b9-9bb3-7710e2ba05a5 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:13.506952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b995d-7828-48b9-9bb3-7710e2ba05a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:13.507226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b995d-7828-48b9-9bb3-7710e2ba05a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:13.508861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ce6b995d-7828-48b9-9bb3-7710e2ba05a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:13.613726 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b995d-7828-48b9-9bb3-7710e2ba05a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:13.615354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b995d-7828-48b9-9bb3-7710e2ba05a5 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:13.635994 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 535/1077] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:15.867760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8d0f2-f32e-43d0-95b0-14508461cf16 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:15.868424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8d0f2-f32e-43d0-95b0-14508461cf16 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:15.868424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8d0f2-f32e-43d0-95b0-14508461cf16 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:15.869654 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 543/1078] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:15.874822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cb0d-c2c0-41b9-8972-52de2a3fcd83 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:15.875259 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cb0d-c2c0-41b9-8972-52de2a3fcd83 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:15.875350 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8cb0d-c2c0-41b9-8972-52de2a3fcd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:15.880467 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:15.946918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5de8cb0d-c2c0-41b9-8972-52de2a3fcd83 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:15.948120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5de8cb0d-c2c0-41b9-8972-52de2a3fcd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:16.065454 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 536/1079] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:16.356145 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8d0f2-f32e-43d0-95b0-14508461cf16 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:16.357699 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7aa8d0f2-f32e-43d0-95b0-14508461cf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:16.520408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8d0f2-f32e-43d0-95b0-14508461cf16 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:16.586001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:16.644404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d8147-b153-4af5-bc5a-57e25750693b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:16.644919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8147-b153-4af5-bc5a-57e25750693b service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:16.645228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8147-b153-4af5-bc5a-57e25750693b service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:16.645501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d8147-b153-4af5-bc5a-57e25750693b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:16.647090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-734d8147-b153-4af5-bc5a-57e25750693b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:16.745547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d8147-b153-4af5-bc5a-57e25750693b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:16.747138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d8147-b153-4af5-bc5a-57e25750693b service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:16.769429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 544/1080] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:19.020303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dc9c3-debf-485c-8d91-46190096cc66 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:19.020876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dc9c3-debf-485c-8d91-46190096cc66 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:19.020876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dc9c3-debf-485c-8d91-46190096cc66 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:19.022233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 537/1081] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:19.027714 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838a9a-3c01-4d10-8044-11efe94148c6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:19.028127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838a9a-3c01-4d10-8044-11efe94148c6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:19.028318 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838a9a-3c01-4d10-8044-11efe94148c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:19.097097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-34838a9a-3c01-4d10-8044-11efe94148c6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:19.098258 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-34838a9a-3c01-4d10-8044-11efe94148c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:19.129502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:19.206494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 545/1082] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:19.499978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dc9c3-debf-485c-8d91-46190096cc66 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:19.502720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f06dc9c3-debf-485c-8d91-46190096cc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:19.597427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:19.695458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dc9c3-debf-485c-8d91-46190096cc66 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:19.866216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d3c90-f978-4a29-97f5-52e5a8935a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:19.867190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d3c90-f978-4a29-97f5-52e5a8935a84 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:19.867461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d3c90-f978-4a29-97f5-52e5a8935a84 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:19.867728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d3c90-f978-4a29-97f5-52e5a8935a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:19.869375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bd5d3c90-f978-4a29-97f5-52e5a8935a84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:19.922783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:19.978970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d3c90-f978-4a29-97f5-52e5a8935a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:19.980653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d3c90-f978-4a29-97f5-52e5a8935a84 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:19.999189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 538/1083] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:22.236239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018833-2ba1-47c4-b05a-15ab92a30633 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:22.237485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018833-2ba1-47c4-b05a-15ab92a30633 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:22.237485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018833-2ba1-47c4-b05a-15ab92a30633 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:22.239181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 546/1084] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:22.244326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374aeff-2fa7-4bd7-92e5-99da0cad4a84 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:22.244741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374aeff-2fa7-4bd7-92e5-99da0cad4a84 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:22.244902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374aeff-2fa7-4bd7-92e5-99da0cad4a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:22.322650 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2374aeff-2fa7-4bd7-92e5-99da0cad4a84 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:22.323841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2374aeff-2fa7-4bd7-92e5-99da0cad4a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:22.430701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 539/1085] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:22.725032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018833-2ba1-47c4-b05a-15ab92a30633 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:22.727115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-40018833-2ba1-47c4-b05a-15ab92a30633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:22.893958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018833-2ba1-47c4-b05a-15ab92a30633 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:22.903998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:23.020201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904aef7-3222-4ccc-9cea-0e610cbd2739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:23.020722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904aef7-3222-4ccc-9cea-0e610cbd2739 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:23.021000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904aef7-3222-4ccc-9cea-0e610cbd2739 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:23.021311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904aef7-3222-4ccc-9cea-0e610cbd2739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:23.026287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a904aef7-3222-4ccc-9cea-0e610cbd2739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:23.129708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904aef7-3222-4ccc-9cea-0e610cbd2739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:23.131326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904aef7-3222-4ccc-9cea-0e610cbd2739 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:23.151052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 547/1086] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:32.429109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:33.147938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:35.926749 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3b5d-6073-4b47-a69d-e9f57730d13f None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:35.927210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3b5d-6073-4b47-a69d-e9f57730d13f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:35.927312 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b3b5d-6073-4b47-a69d-e9f57730d13f None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:35.928643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 540/1087] 10.222.0.13 () {54 vars in 918 bytes} [Wed Nov 2 07:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:35.933769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74baa6-bda0-4547-86c0-1dcdcfa1ecfd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:35.934196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74baa6-bda0-4547-86c0-1dcdcfa1ecfd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:35.934374 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74baa6-bda0-4547-86c0-1dcdcfa1ecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:36.013220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-be74baa6-bda0-4547-86c0-1dcdcfa1ecfd None None] MFA Rules not processed for user `55214b594a3f42ff8a7e0cecdef98937`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:36.014435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-be74baa6-bda0-4547-86c0-1dcdcfa1ecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:36.120455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 548/1088] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Nov 2 07:20:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:36.135031 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadcc65-6d42-4e92-9772-6368264c02c3 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:36.135310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadcc65-6d42-4e92-9772-6368264c02c3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:36.135580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadcc65-6d42-4e92-9772-6368264c02c3 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:36.136884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 541/1089] 10.222.0.13 () {54 vars in 918 bytes} [Wed Nov 2 07:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:36.141460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f0852-6c6c-419e-bb63-1f38c6dcb32b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:36.141736 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f0852-6c6c-419e-bb63-1f38c6dcb32b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:36.142022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f0852-6c6c-419e-bb63-1f38c6dcb32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:36.214148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:36.216768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ad2f0852-6c6c-419e-bb63-1f38c6dcb32b None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:36.218530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ad2f0852-6c6c-419e-bb63-1f38c6dcb32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:36.332837 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 549/1090] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Nov 2 07:20:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:20:38.918195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ac2c9-5e1d-4e69-80d3-c27b2982fe44 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:38.918666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ac2c9-5e1d-4e69-80d3-c27b2982fe44 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:38.918770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ac2c9-5e1d-4e69-80d3-c27b2982fe44 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:38.920073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 542/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:38.925748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb4fb-6d68-433f-8ed4-1eb10205be6e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:38.926159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb4fb-6d68-433f-8ed4-1eb10205be6e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:38.926275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb4fb-6d68-433f-8ed4-1eb10205be6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:38.994484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f6edb4fb-6d68-433f-8ed4-1eb10205be6e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:38.995689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f6edb4fb-6d68-433f-8ed4-1eb10205be6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:39.050756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:39.092340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 550/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:39.382192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ac2c9-5e1d-4e69-80d3-c27b2982fe44 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:39.383864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-906ac2c9-5e1d-4e69-80d3-c27b2982fe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:39.531442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ac2c9-5e1d-4e69-80d3-c27b2982fe44 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:39.603664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:39.643594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa9920-aa03-4368-9f4a-ce716bf1a9ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:39.644118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa9920-aa03-4368-9f4a-ce716bf1a9ab service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:39.644395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa9920-aa03-4368-9f4a-ce716bf1a9ab service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:39.644662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa9920-aa03-4368-9f4a-ce716bf1a9ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:39.646269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a4aa9920-aa03-4368-9f4a-ce716bf1a9ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:39.734777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa9920-aa03-4368-9f4a-ce716bf1a9ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:39.737165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa9920-aa03-4368-9f4a-ce716bf1a9ab service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:39.754750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 543/1093] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:40.885978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb7099-705d-4d6d-87e6-faa31df27fa6 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:40.886543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb7099-705d-4d6d-87e6-faa31df27fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:40.886543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb7099-705d-4d6d-87e6-faa31df27fa6 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:40.887880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 551/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:40.893637 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629ec17-6603-4433-a1ba-7f0d8557512c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:40.894071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629ec17-6603-4433-a1ba-7f0d8557512c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:40.894171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629ec17-6603-4433-a1ba-7f0d8557512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:40.971047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0629ec17-6603-4433-a1ba-7f0d8557512c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:40.972592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0629ec17-6603-4433-a1ba-7f0d8557512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:40.999277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:41.069238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 544/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:41.222107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb7099-705d-4d6d-87e6-faa31df27fa6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:41.223539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0ddb7099-705d-4d6d-87e6-faa31df27fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:41.367514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb7099-705d-4d6d-87e6-faa31df27fa6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:41.407059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:41.484311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01ca5b-8210-4c21-af66-e1aad3d61263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:41.484830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ca5b-8210-4c21-af66-e1aad3d61263 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:41.485130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ca5b-8210-4c21-af66-e1aad3d61263 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:41.485399 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ca5b-8210-4c21-af66-e1aad3d61263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:41.487471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bc01ca5b-8210-4c21-af66-e1aad3d61263 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:41.575729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01ca5b-8210-4c21-af66-e1aad3d61263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:41.577319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01ca5b-8210-4c21-af66-e1aad3d61263 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:41.595095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 552/1096] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:42.707974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7256148-f428-4a82-8097-4b55a9f452a0 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:42.708512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7256148-f428-4a82-8097-4b55a9f452a0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:42.708512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7256148-f428-4a82-8097-4b55a9f452a0 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:42.709895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 545/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:42.714946 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c4826-3c4e-4f69-ae1e-488a766f7936 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:42.715367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c4826-3c4e-4f69-ae1e-488a766f7936 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:42.715500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c4826-3c4e-4f69-ae1e-488a766f7936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:42.769595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:42.791967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6a9c4826-3c4e-4f69-ae1e-488a766f7936 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:42.793210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6a9c4826-3c4e-4f69-ae1e-488a766f7936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:42.888548 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 553/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:43.052164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7256148-f428-4a82-8097-4b55a9f452a0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:43.052529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d7256148-f428-4a82-8097-4b55a9f452a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:43.196517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7256148-f428-4a82-8097-4b55a9f452a0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:43.208990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:43.307154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab7de1-1c2b-4ad3-9de4-3fd366a98be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:43.307671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab7de1-1c2b-4ad3-9de4-3fd366a98be5 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:43.307944 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab7de1-1c2b-4ad3-9de4-3fd366a98be5 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:43.308215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab7de1-1c2b-4ad3-9de4-3fd366a98be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:43.309823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f4ab7de1-1c2b-4ad3-9de4-3fd366a98be5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:43.399319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab7de1-1c2b-4ad3-9de4-3fd366a98be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:43.400888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab7de1-1c2b-4ad3-9de4-3fd366a98be5 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:43.418318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 546/1099] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:44.517239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5327-001e-4566-9107-5f6b204bb08b None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:44.517816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5327-001e-4566-9107-5f6b204bb08b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:44.517816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b5327-001e-4566-9107-5f6b204bb08b None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:44.519164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 554/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:44.523996 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c7c2-f401-461e-8d06-20168cf22bde None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:44.524450 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c7c2-f401-461e-8d06-20168cf22bde None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:44.524564 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c7c2-f401-461e-8d06-20168cf22bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:44.544342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:44.601328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-aa85c7c2-f401-461e-8d06-20168cf22bde None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:44.602524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aa85c7c2-f401-461e-8d06-20168cf22bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:44.700666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 547/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:44.850534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b5327-001e-4566-9107-5f6b204bb08b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:44.852048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0d7b5327-001e-4566-9107-5f6b204bb08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:44.963574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:44.999162 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b5327-001e-4566-9107-5f6b204bb08b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:45.111996 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb4759-8bb0-4138-8b60-16a0e836e910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:45.112527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4759-8bb0-4138-8b60-16a0e836e910 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:45.112796 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4759-8bb0-4138-8b60-16a0e836e910 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:45.113082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4759-8bb0-4138-8b60-16a0e836e910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:45.114659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3fcb4759-8bb0-4138-8b60-16a0e836e910 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:45.190125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:45.203878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb4759-8bb0-4138-8b60-16a0e836e910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:45.205641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb4759-8bb0-4138-8b60-16a0e836e910 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:45.223603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 555/1102] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:46.320443 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0f999-9449-4c4d-93ed-f7af9ad6bc71 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:46.320989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0f999-9449-4c4d-93ed-f7af9ad6bc71 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:46.320989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0f999-9449-4c4d-93ed-f7af9ad6bc71 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:46.322362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 548/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:46.327276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117152a-4c1e-47fe-bd85-9da1d81e6015 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:46.327707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117152a-4c1e-47fe-bd85-9da1d81e6015 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:46.327819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117152a-4c1e-47fe-bd85-9da1d81e6015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:46.404279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c117152a-4c1e-47fe-bd85-9da1d81e6015 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:46.405518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c117152a-4c1e-47fe-bd85-9da1d81e6015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:46.500787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 556/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:46.656696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0f999-9449-4c4d-93ed-f7af9ad6bc71 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:46.658153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-07d0f999-9449-4c4d-93ed-f7af9ad6bc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:46.741152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:46.802369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0f999-9449-4c4d-93ed-f7af9ad6bc71 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:46.915018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64d81d-b11b-487f-a064-097b3b9fe48e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:46.915624 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64d81d-b11b-487f-a064-097b3b9fe48e service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:46.915897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64d81d-b11b-487f-a064-097b3b9fe48e service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:46.916162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64d81d-b11b-487f-a064-097b3b9fe48e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:46.917848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cc64d81d-b11b-487f-a064-097b3b9fe48e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:46.967219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:47.008593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64d81d-b11b-487f-a064-097b3b9fe48e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:47.010268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64d81d-b11b-487f-a064-097b3b9fe48e service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:47.031645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 549/1105] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:48.074755 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d62adf-ddd4-483c-b04d-bf8f71ae6605 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:48.075372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d62adf-ddd4-483c-b04d-bf8f71ae6605 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:48.075372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d62adf-ddd4-483c-b04d-bf8f71ae6605 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:48.076610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 557/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:48.081652 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884429e1-a29b-41e8-8a9f-0d927e7c8ca2 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:48.082054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884429e1-a29b-41e8-8a9f-0d927e7c8ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:48.082190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884429e1-a29b-41e8-8a9f-0d927e7c8ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:48.158394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-884429e1-a29b-41e8-8a9f-0d927e7c8ca2 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:48.159630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-884429e1-a29b-41e8-8a9f-0d927e7c8ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:48.256705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 550/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:48.406582 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d62adf-ddd4-483c-b04d-bf8f71ae6605 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:48.408087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-47d62adf-ddd4-483c-b04d-bf8f71ae6605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:48.457768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:48.559894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d62adf-ddd4-483c-b04d-bf8f71ae6605 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:48.671624 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e60dd5-ad2c-46b2-93b6-05985df1b274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:48.672227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e60dd5-ad2c-46b2-93b6-05985df1b274 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:48.672505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e60dd5-ad2c-46b2-93b6-05985df1b274 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:48.672775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e60dd5-ad2c-46b2-93b6-05985df1b274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:48.674493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-36e60dd5-ad2c-46b2-93b6-05985df1b274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:48.682095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:48.765894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e60dd5-ad2c-46b2-93b6-05985df1b274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:48.767406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e60dd5-ad2c-46b2-93b6-05985df1b274 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:48.786556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 558/1108] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:49.822255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0c33b-db97-4fea-a623-b048129d18d9 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:49.822825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0c33b-db97-4fea-a623-b048129d18d9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:49.822825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0c33b-db97-4fea-a623-b048129d18d9 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:49.824197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 551/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:49.829315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7feaf-c642-4433-9691-f412cfa3951c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:49.829711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7feaf-c642-4433-9691-f412cfa3951c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:49.829858 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7feaf-c642-4433-9691-f412cfa3951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:49.907325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-abd7feaf-c642-4433-9691-f412cfa3951c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:49.908529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-abd7feaf-c642-4433-9691-f412cfa3951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:49.976207 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:50.005002 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 559/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:50.154658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0c33b-db97-4fea-a623-b048129d18d9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:50.156109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e8b0c33b-db97-4fea-a623-b048129d18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:50.173576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:50.301420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0c33b-db97-4fea-a623-b048129d18d9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:50.387168 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:50.413817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cbbd7-1011-4493-9d2b-b8a267efebaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:50.414336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cbbd7-1011-4493-9d2b-b8a267efebaa service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:50.414612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cbbd7-1011-4493-9d2b-b8a267efebaa service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:50.414889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cbbd7-1011-4493-9d2b-b8a267efebaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:50.416473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-257cbbd7-1011-4493-9d2b-b8a267efebaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:50.507971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cbbd7-1011-4493-9d2b-b8a267efebaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:50.509591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cbbd7-1011-4493-9d2b-b8a267efebaa service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:50.527454 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 552/1111] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:51.577663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced8a8d-c240-4c23-87fb-856e5fe45759 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:51.578231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced8a8d-c240-4c23-87fb-856e5fe45759 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:51.578231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced8a8d-c240-4c23-87fb-856e5fe45759 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:51.579527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 560/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:51.584452 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14824-3d32-4188-9f28-9163467a4d8f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:51.584888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14824-3d32-4188-9f28-9163467a4d8f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:51.585049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14824-3d32-4188-9f28-9163467a4d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:51.662252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-efb14824-3d32-4188-9f28-9163467a4d8f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:51.663449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-efb14824-3d32-4188-9f28-9163467a4d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:51.704705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:51.758728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 553/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:51.908565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced8a8d-c240-4c23-87fb-856e5fe45759 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:51.911290 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cced8a8d-c240-4c23-87fb-856e5fe45759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:52.056707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced8a8d-c240-4c23-87fb-856e5fe45759 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:52.110167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:52.169117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a94fd2-e503-4604-9973-1a343fa3b967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:52.169706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a94fd2-e503-4604-9973-1a343fa3b967 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:52.169978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a94fd2-e503-4604-9973-1a343fa3b967 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:52.170239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a94fd2-e503-4604-9973-1a343fa3b967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:52.171799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-85a94fd2-e503-4604-9973-1a343fa3b967 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:52.259290 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a94fd2-e503-4604-9973-1a343fa3b967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:52.260876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a94fd2-e503-4604-9973-1a343fa3b967 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:52.279330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 561/1114] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:53.349285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6426fd-8f7f-4c21-a32c-dd2c180860f9 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:53.349814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6426fd-8f7f-4c21-a32c-dd2c180860f9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:53.349814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6426fd-8f7f-4c21-a32c-dd2c180860f9 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:53.351170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 554/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:53.356119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636dae4-19ee-4fa6-bde7-962a5993bfb6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:53.356543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636dae4-19ee-4fa6-bde7-962a5993bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:53.356660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636dae4-19ee-4fa6-bde7-962a5993bfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:53.434404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f636dae4-19ee-4fa6-bde7-962a5993bfb6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:53.435605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f636dae4-19ee-4fa6-bde7-962a5993bfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:53.437648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:53.533444 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 562/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:53.685554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6426fd-8f7f-4c21-a32c-dd2c180860f9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:53.686961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0f6426fd-8f7f-4c21-a32c-dd2c180860f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:53.830901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6426fd-8f7f-4c21-a32c-dd2c180860f9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:53.858438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:53.944549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a0ac7-29ef-4265-a968-f609cf0d644f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:53.945109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a0ac7-29ef-4265-a968-f609cf0d644f service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:53.945383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a0ac7-29ef-4265-a968-f609cf0d644f service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:53.945648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a0ac7-29ef-4265-a968-f609cf0d644f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:53.947218 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-878a0ac7-29ef-4265-a968-f609cf0d644f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:54.035185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a0ac7-29ef-4265-a968-f609cf0d644f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:54.036773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a0ac7-29ef-4265-a968-f609cf0d644f service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:54.054260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 555/1117] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:56.120611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea1cbf-4442-4bd8-a4b7-0677bfee6ee3 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:56.121174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea1cbf-4442-4bd8-a4b7-0677bfee6ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:56.121174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea1cbf-4442-4bd8-a4b7-0677bfee6ee3 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:56.122528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 563/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:56.128022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafe92-b9e5-4178-82ce-0cf18e11aad7 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:56.128407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafe92-b9e5-4178-82ce-0cf18e11aad7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:56.128537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafe92-b9e5-4178-82ce-0cf18e11aad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:56.168832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:56.195193 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6dbafe92-b9e5-4178-82ce-0cf18e11aad7 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:56.196384 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6dbafe92-b9e5-4178-82ce-0cf18e11aad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:56.290791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 556/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:56.574630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea1cbf-4442-4bd8-a4b7-0677bfee6ee3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:56.576163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f6ea1cbf-4442-4bd8-a4b7-0677bfee6ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:56.680382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea1cbf-4442-4bd8-a4b7-0677bfee6ee3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:56.711727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:56.755052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42512519-d998-4526-a8ad-4c896cd913cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:56.755569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512519-d998-4526-a8ad-4c896cd913cc service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:56.755842 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512519-d998-4526-a8ad-4c896cd913cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:56.756107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512519-d998-4526-a8ad-4c896cd913cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:56.757692 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-42512519-d998-4526-a8ad-4c896cd913cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:56.866123 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42512519-d998-4526-a8ad-4c896cd913cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:56.867546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42512519-d998-4526-a8ad-4c896cd913cc service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:20:56.885868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 564/1120] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:20:59.244755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b11bb-eead-45c8-aee5-ca16cafc09d8 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:59.245377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b11bb-eead-45c8-aee5-ca16cafc09d8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:59.245377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b11bb-eead-45c8-aee5-ca16cafc09d8 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:59.246724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 557/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:20:59.252009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf7ec4-f6e9-46d6-8ccb-f3dde59f4f63 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:59.252475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf7ec4-f6e9-46d6-8ccb-f3dde59f4f63 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:59.252674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf7ec4-f6e9-46d6-8ccb-f3dde59f4f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:59.317335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6acf7ec4-f6e9-46d6-8ccb-f3dde59f4f63 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:20:59.318526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6acf7ec4-f6e9-46d6-8ccb-f3dde59f4f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:59.331621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:59.414893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 565/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:20:59.700624 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b11bb-eead-45c8-aee5-ca16cafc09d8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:20:59.702206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fa6b11bb-eead-45c8-aee5-ca16cafc09d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:59.804084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b11bb-eead-45c8-aee5-ca16cafc09d8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:20:59.816888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:20:59.878601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f7396-e14a-406a-b145-a6d943551ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:20:59.879192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f7396-e14a-406a-b145-a6d943551ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:20:59.879465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f7396-e14a-406a-b145-a6d943551ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:20:59.879730 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f7396-e14a-406a-b145-a6d943551ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:20:59.881356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a71f7396-e14a-406a-b145-a6d943551ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:20:59.990120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f7396-e14a-406a-b145-a6d943551ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:20:59.991471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f7396-e14a-406a-b145-a6d943551ee3 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:00.010786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 558/1123] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:02.528068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75389b74-3f63-41f9-ad97-1cea26aca382 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:02.528573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75389b74-3f63-41f9-ad97-1cea26aca382 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:02.528667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75389b74-3f63-41f9-ad97-1cea26aca382 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:02.529968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 566/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:02.535528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac3010-c9cd-42f8-b594-aa4e35ab81be None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:02.536239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac3010-c9cd-42f8-b594-aa4e35ab81be None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:02.536442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac3010-c9cd-42f8-b594-aa4e35ab81be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:02.585264 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:02.603966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-89ac3010-c9cd-42f8-b594-aa4e35ab81be None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:02.605197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-89ac3010-c9cd-42f8-b594-aa4e35ab81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:02.702251 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 559/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:02.990563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75389b74-3f63-41f9-ad97-1cea26aca382 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:02.992083 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-75389b74-3f63-41f9-ad97-1cea26aca382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:03.094952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75389b74-3f63-41f9-ad97-1cea26aca382 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:03.137070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:03.171060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9da106-804e-40cd-a9b8-3370eef15a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:03.171585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9da106-804e-40cd-a9b8-3370eef15a8b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:03.171863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9da106-804e-40cd-a9b8-3370eef15a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:03.172132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9da106-804e-40cd-a9b8-3370eef15a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:03.173750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-df9da106-804e-40cd-a9b8-3370eef15a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:03.283537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9da106-804e-40cd-a9b8-3370eef15a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:03.284960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9da106-804e-40cd-a9b8-3370eef15a8b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:03.303096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 567/1126] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:05.600539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1502-01d5-4a6a-9a8e-3ba66afdd6bd None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:05.601099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1502-01d5-4a6a-9a8e-3ba66afdd6bd None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:05.601099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1502-01d5-4a6a-9a8e-3ba66afdd6bd None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:05.602447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 560/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:05.607718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6845-cb5e-426f-adf9-9a0d590eb268 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:05.608128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6845-cb5e-426f-adf9-9a0d590eb268 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:05.608357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6845-cb5e-426f-adf9-9a0d590eb268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:05.675301 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0f1a6845-cb5e-426f-adf9-9a0d590eb268 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:05.676520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0f1a6845-cb5e-426f-adf9-9a0d590eb268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:05.696874 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:05.772335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 568/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:06.065558 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1502-01d5-4a6a-9a8e-3ba66afdd6bd None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:06.067083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-eefb1502-01d5-4a6a-9a8e-3ba66afdd6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:06.169975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1502-01d5-4a6a-9a8e-3ba66afdd6bd None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:06.189561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:06.243344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51c4ca-7395-4e16-9c1d-ace41d6ef277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:06.243938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c4ca-7395-4e16-9c1d-ace41d6ef277 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:06.244211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c4ca-7395-4e16-9c1d-ace41d6ef277 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:06.244478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c4ca-7395-4e16-9c1d-ace41d6ef277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:06.246083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8f51c4ca-7395-4e16-9c1d-ace41d6ef277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:06.353394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51c4ca-7395-4e16-9c1d-ace41d6ef277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:06.354825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51c4ca-7395-4e16-9c1d-ace41d6ef277 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:06.372401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 561/1129] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:08.693486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f8cad-2353-4900-880f-6a84a3e98841 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:08.694069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f8cad-2353-4900-880f-6a84a3e98841 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:08.694069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f8cad-2353-4900-880f-6a84a3e98841 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:08.695361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 569/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:08.700599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64037536-e34b-45ae-9374-b9ddb32eede8 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:08.701033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64037536-e34b-45ae-9374-b9ddb32eede8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:08.701177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64037536-e34b-45ae-9374-b9ddb32eede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:08.763781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:08.766511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-64037536-e34b-45ae-9374-b9ddb32eede8 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:08.768210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-64037536-e34b-45ae-9374-b9ddb32eede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:08.863896 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 562/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:09.148362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f8cad-2353-4900-880f-6a84a3e98841 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:09.149944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e93f8cad-2353-4900-880f-6a84a3e98841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:09.253473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f8cad-2353-4900-880f-6a84a3e98841 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:09.302545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:09.326653 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d09764-cca9-4b12-b2c9-44d4ceb9e4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:09.327249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d09764-cca9-4b12-b2c9-44d4ceb9e4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:09.327522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d09764-cca9-4b12-b2c9-44d4ceb9e4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:09.327789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d09764-cca9-4b12-b2c9-44d4ceb9e4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:09.329402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-41d09764-cca9-4b12-b2c9-44d4ceb9e4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:09.439678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d09764-cca9-4b12-b2c9-44d4ceb9e4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:09.441181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d09764-cca9-4b12-b2c9-44d4ceb9e4d4 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:09.459391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 570/1132] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:11.685368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d2bd2-c79a-4227-8544-31948bf269c2 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:11.685938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d2bd2-c79a-4227-8544-31948bf269c2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:11.685938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d2bd2-c79a-4227-8544-31948bf269c2 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:11.687267 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 563/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:11.693138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94c31-a10b-4a76-983c-4989351cce95 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:11.693542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94c31-a10b-4a76-983c-4989351cce95 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:11.693685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94c31-a10b-4a76-983c-4989351cce95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:11.759459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-fdc94c31-a10b-4a76-983c-4989351cce95 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:11.760668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fdc94c31-a10b-4a76-983c-4989351cce95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:11.789684 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:11.855888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 571/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:12.142245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d2bd2-c79a-4227-8544-31948bf269c2 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:12.144344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-537d2bd2-c79a-4227-8544-31948bf269c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:12.247119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d2bd2-c79a-4227-8544-31948bf269c2 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:12.275134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:12.319201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c39f8-0403-4b7e-aa6a-2b52201e9e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:12.319803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c39f8-0403-4b7e-aa6a-2b52201e9e47 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:12.320079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c39f8-0403-4b7e-aa6a-2b52201e9e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:12.320345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c39f8-0403-4b7e-aa6a-2b52201e9e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:12.321961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b88c39f8-0403-4b7e-aa6a-2b52201e9e47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:12.428319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c39f8-0403-4b7e-aa6a-2b52201e9e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:12.429703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c39f8-0403-4b7e-aa6a-2b52201e9e47 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:12.447406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 564/1135] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:14.680939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7685fa2-8239-4531-ba8c-9acc8e406367 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:14.681535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7685fa2-8239-4531-ba8c-9acc8e406367 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:14.681535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7685fa2-8239-4531-ba8c-9acc8e406367 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:14.682819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 572/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:14.688153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f4810-404e-4490-b9c4-6bd3bac157d1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:14.688582 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f4810-404e-4490-b9c4-6bd3bac157d1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:14.688720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f4810-404e-4490-b9c4-6bd3bac157d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:14.754534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-806f4810-404e-4490-b9c4-6bd3bac157d1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:14.755642 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-806f4810-404e-4490-b9c4-6bd3bac157d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:14.763733 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:14.850334 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 565/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:21:15.137593 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7685fa2-8239-4531-ba8c-9acc8e406367 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:15.139126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c7685fa2-8239-4531-ba8c-9acc8e406367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:15.246487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7685fa2-8239-4531-ba8c-9acc8e406367 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:15.302565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:15.321265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63d32e-fd9a-4256-8998-1a9dddaa87d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:15.321868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d32e-fd9a-4256-8998-1a9dddaa87d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:15.322146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d32e-fd9a-4256-8998-1a9dddaa87d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:15.322418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63d32e-fd9a-4256-8998-1a9dddaa87d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:15.324000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ce63d32e-fd9a-4256-8998-1a9dddaa87d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:15.433225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63d32e-fd9a-4256-8998-1a9dddaa87d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:15.434568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63d32e-fd9a-4256-8998-1a9dddaa87d3 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:15.452507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 573/1138] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:17.653645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0131-128e-45cb-9267-5c3f99c368ef None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:17.654265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0131-128e-45cb-9267-5c3f99c368ef None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:17.654265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0131-128e-45cb-9267-5c3f99c368ef None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:17.655531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 566/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:17.661484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e11ca-fee4-4460-927f-c789d0fb8b5c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:17.661926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e11ca-fee4-4460-927f-c789d0fb8b5c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:17.662033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e11ca-fee4-4460-927f-c789d0fb8b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:17.727886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e23e11ca-fee4-4460-927f-c789d0fb8b5c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:17.729043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e23e11ca-fee4-4460-927f-c789d0fb8b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:17.767969 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:17.825211 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 574/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:18.112344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0131-128e-45cb-9267-5c3f99c368ef None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:18.113937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-174b0131-128e-45cb-9267-5c3f99c368ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:18.219904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0131-128e-45cb-9267-5c3f99c368ef None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:18.260049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:18.296676 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5729b-7bc8-40bd-a418-264d0658f568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:18.297324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5729b-7bc8-40bd-a418-264d0658f568 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:18.297600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5729b-7bc8-40bd-a418-264d0658f568 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:18.297865 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5729b-7bc8-40bd-a418-264d0658f568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:18.301475 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-03e5729b-7bc8-40bd-a418-264d0658f568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:18.411769 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5729b-7bc8-40bd-a418-264d0658f568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:18.413155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5729b-7bc8-40bd-a418-264d0658f568 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:18.432023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 567/1141] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:20.610949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90ce99-4404-4805-8d58-8d79277ab46c None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:20.612003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90ce99-4404-4805-8d58-8d79277ab46c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:20.612229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90ce99-4404-4805-8d58-8d79277ab46c None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:20.613606 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 575/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:20.618844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817732-669e-4ce8-a2ca-4e9eb7abe5a5 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:20.619274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817732-669e-4ce8-a2ca-4e9eb7abe5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:20.619433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9817732-669e-4ce8-a2ca-4e9eb7abe5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:20.684681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d9817732-669e-4ce8-a2ca-4e9eb7abe5a5 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:20.685887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d9817732-669e-4ce8-a2ca-4e9eb7abe5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:20.703136 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:20.781746 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 568/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:21.068939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90ce99-4404-4805-8d58-8d79277ab46c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:21.070501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ec90ce99-4404-4805-8d58-8d79277ab46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:21.173202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90ce99-4404-4805-8d58-8d79277ab46c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:21.241045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:21.247883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04377cf2-ab9f-4b48-a8d1-88deee793a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:21.248478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377cf2-ab9f-4b48-a8d1-88deee793a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:21.248753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377cf2-ab9f-4b48-a8d1-88deee793a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:21.249039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377cf2-ab9f-4b48-a8d1-88deee793a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:21.250622 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-04377cf2-ab9f-4b48-a8d1-88deee793a77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:21.358526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04377cf2-ab9f-4b48-a8d1-88deee793a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:21.359880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04377cf2-ab9f-4b48-a8d1-88deee793a77 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:21.378426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 576/1144] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:23.546249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29dae4-27c1-48b8-a92d-523e4414c39e None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:23.546815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29dae4-27c1-48b8-a92d-523e4414c39e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:23.546815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29dae4-27c1-48b8-a92d-523e4414c39e None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:23.548097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 569/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:23.553896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa11a-496d-4c42-99b9-fb4e491acc01 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:23.554301 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa11a-496d-4c42-99b9-fb4e491acc01 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:23.554436 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa11a-496d-4c42-99b9-fb4e491acc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:23.620348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-939aa11a-496d-4c42-99b9-fb4e491acc01 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:23.621560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-939aa11a-496d-4c42-99b9-fb4e491acc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:23.668973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:23.717181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 577/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:24.000309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29dae4-27c1-48b8-a92d-523e4414c39e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:24.002166 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ba29dae4-27c1-48b8-a92d-523e4414c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:24.103621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29dae4-27c1-48b8-a92d-523e4414c39e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:24.151922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:24.177740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4562be-b8ed-436c-b54b-6c7b827d5935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:24.178272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4562be-b8ed-436c-b54b-6c7b827d5935 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:24.178546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4562be-b8ed-436c-b54b-6c7b827d5935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:24.178819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4562be-b8ed-436c-b54b-6c7b827d5935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:24.180406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1f4562be-b8ed-436c-b54b-6c7b827d5935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:24.287532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4562be-b8ed-436c-b54b-6c7b827d5935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:24.288952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4562be-b8ed-436c-b54b-6c7b827d5935 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:24.306548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 570/1147] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:33.715607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=22 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:34.304311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=66 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:44.200880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e1c7-b085-4ac0-8585-b3e1f27a8e6e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:44.201496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e1c7-b085-4ac0-8585-b3e1f27a8e6e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:44.201496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3e1c7-b085-4ac0-8585-b3e1f27a8e6e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:44.202717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 578/1148] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:44.208475 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820aba13-7d74-4804-8284-7ff4c5d8fa85 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:44.208888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820aba13-7d74-4804-8284-7ff4c5d8fa85 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:44.209187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820aba13-7d74-4804-8284-7ff4c5d8fa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:44.276091 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-820aba13-7d74-4804-8284-7ff4c5d8fa85 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:44.277306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-820aba13-7d74-4804-8284-7ff4c5d8fa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:44.371436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 571/1149] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:44.668864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48689d9a-551e-4598-9741-a4bdb909cedc None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:44.669182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48689d9a-551e-4598-9741-a4bdb909cedc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:44.669453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48689d9a-551e-4598-9741-a4bdb909cedc None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:44.670761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 579/1150] 10.222.0.13 () {54 vars in 962 bytes} [Wed Nov 2 07:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:44.676433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e184-4b55-43bf-a321-60d43ed89d40 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:44.676714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e184-4b55-43bf-a321-60d43ed89d40 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:44.676987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7e184-4b55-43bf-a321-60d43ed89d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:44.751966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-47e7e184-4b55-43bf-a321-60d43ed89d40 None None] MFA Rules not processed for user `c27a93c04181493593a069650a977773`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:44.753180 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-47e7e184-4b55-43bf-a321-60d43ed89d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:44.773221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:44.829123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 572/1151] 10.222.0.13 () {58 vars in 1059 bytes} [Wed Nov 2 07:21:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:44.837288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48689d9a-551e-4598-9741-a4bdb909cedc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:44.838865 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-48689d9a-551e-4598-9741-a4bdb909cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:44.946812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48689d9a-551e-4598-9741-a4bdb909cedc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:45.021196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf6c7a-c25a-4154-812b-e08d4feae609 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27a93c04181493593a069650a977773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:45.021719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf6c7a-c25a-4154-812b-e08d4feae609 service glance] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:45.021996 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf6c7a-c25a-4154-812b-e08d4feae609 service glance] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:45.022262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf6c7a-c25a-4154-812b-e08d4feae609 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:45.023833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2ecf6c7a-c25a-4154-812b-e08d4feae609 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:45.076831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:45.131502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf6c7a-c25a-4154-812b-e08d4feae609 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:45.132922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf6c7a-c25a-4154-812b-e08d4feae609 service glance] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:45.153799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 580/1152] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:21:47.384751 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649286a-5043-4244-8e4d-9453f45bb4db None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:47.385361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649286a-5043-4244-8e4d-9453f45bb4db None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:47.385361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649286a-5043-4244-8e4d-9453f45bb4db None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:47.386689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 573/1153] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:47.392152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7feba-1aad-46b1-b059-6806714ea571 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:47.392577 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7feba-1aad-46b1-b059-6806714ea571 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:47.392689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7feba-1aad-46b1-b059-6806714ea571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:47.467205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e6c7feba-1aad-46b1-b059-6806714ea571 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:47.468431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e6c7feba-1aad-46b1-b059-6806714ea571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:47.565451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 581/1154] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:21:47.840263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649286a-5043-4244-8e4d-9453f45bb4db None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:47.841827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a649286a-5043-4244-8e4d-9453f45bb4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:47.966026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649286a-5043-4244-8e4d-9453f45bb4db None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:48.021081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:48.064961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9a98f-608a-4cf0-b6a3-2fa38e3731f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:48.065587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9a98f-608a-4cf0-b6a3-2fa38e3731f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:48.065861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9a98f-608a-4cf0-b6a3-2fa38e3731f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:48.066128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9a98f-608a-4cf0-b6a3-2fa38e3731f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:48.066750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9a98f-608a-4cf0-b6a3-2fa38e3731f3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:48.067840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-1ba9a98f-608a-4cf0-b6a3-2fa38e3731f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:21:48.067840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: warnings.warn(msg) Nov 02 07:21:48.067840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: Nov 02 07:21:48.068953 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9a98f-608a-4cf0-b6a3-2fa38e3731f3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:48.087268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 574/1155] 10.222.0.13 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:47 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:21:50.262185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c7d97-2429-4759-8018-d4787fd58599 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.262723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c7d97-2429-4759-8018-d4787fd58599 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.262723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c7d97-2429-4759-8018-d4787fd58599 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.264032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 582/1156] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:50.269423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260571b-c86a-4d6d-bcf5-9782fc682847 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.269866 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260571b-c86a-4d6d-bcf5-9782fc682847 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.269976 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260571b-c86a-4d6d-bcf5-9782fc682847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.336111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b260571b-c86a-4d6d-bcf5-9782fc682847 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:50.337326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b260571b-c86a-4d6d-bcf5-9782fc682847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:50.432311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 575/1157] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:50.727455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c7d97-2429-4759-8018-d4787fd58599 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:50.729068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e83c7d97-2429-4759-8018-d4787fd58599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:50.739533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:50.874151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c7d97-2429-4759-8018-d4787fd58599 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:50.952879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:50.986520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b03c6d-40ce-4e0b-8ee4-b3579e6820bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:50.987075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b03c6d-40ce-4e0b-8ee4-b3579e6820bf service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.987346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b03c6d-40ce-4e0b-8ee4-b3579e6820bf service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.987613 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b03c6d-40ce-4e0b-8ee4-b3579e6820bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.989209 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-55b03c6d-40ce-4e0b-8ee4-b3579e6820bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:51.078443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b03c6d-40ce-4e0b-8ee4-b3579e6820bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.080594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b03c6d-40ce-4e0b-8ee4-b3579e6820bf service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.098792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 583/1158] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:53.423205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6ba6-4e5e-4834-9f2e-dcb5d1da24f8 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:53.423949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6ba6-4e5e-4834-9f2e-dcb5d1da24f8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:53.423949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6ba6-4e5e-4834-9f2e-dcb5d1da24f8 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:53.425157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 576/1159] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:53.430430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7723d7-4d47-415a-aad4-60d10b1f28bb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:53.430854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7723d7-4d47-415a-aad4-60d10b1f28bb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:53.430970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7723d7-4d47-415a-aad4-60d10b1f28bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:53.498742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1a7723d7-4d47-415a-aad4-60d10b1f28bb None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:53.499982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1a7723d7-4d47-415a-aad4-60d10b1f28bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:53.545275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:53.596247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 584/1160] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:53.884164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6ba6-4e5e-4834-9f2e-dcb5d1da24f8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:53.885764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4c6f6ba6-4e5e-4834-9f2e-dcb5d1da24f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:53.909820 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:53.990313 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6ba6-4e5e-4834-9f2e-dcb5d1da24f8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:54.062049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c0c2-3381-47bf-8223-cc80734acd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:54.062644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c0c2-3381-47bf-8223-cc80734acd5e service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.062913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c0c2-3381-47bf-8223-cc80734acd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.063173 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c0c2-3381-47bf-8223-cc80734acd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.065451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ffe7c0c2-3381-47bf-8223-cc80734acd5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:54.139604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:54.174878 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7c0c2-3381-47bf-8223-cc80734acd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:54.176302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7c0c2-3381-47bf-8223-cc80734acd5e service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:54.194524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 577/1161] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:56.407489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32199f8-cce1-4f24-b8de-50540bffc22e None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.408136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32199f8-cce1-4f24-b8de-50540bffc22e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.408136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32199f8-cce1-4f24-b8de-50540bffc22e None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.409471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 585/1162] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:56.414863 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cde79d-1173-4cac-a376-9897800e2740 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.415282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cde79d-1173-4cac-a376-9897800e2740 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.415391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cde79d-1173-4cac-a376-9897800e2740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.480788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-69cde79d-1173-4cac-a376-9897800e2740 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:56.482014 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-69cde79d-1173-4cac-a376-9897800e2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:56.577265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 578/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:56.867185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32199f8-cce1-4f24-b8de-50540bffc22e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.868703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f32199f8-cce1-4f24-b8de-50540bffc22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:56.973187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32199f8-cce1-4f24-b8de-50540bffc22e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.044035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:57.045665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3516f1-eec7-4259-bc41-70210e540d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.046321 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3516f1-eec7-4259-bc41-70210e540d5b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.046836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3516f1-eec7-4259-bc41-70210e540d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.047304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3516f1-eec7-4259-bc41-70210e540d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.049617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1e3516f1-eec7-4259-bc41-70210e540d5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:57.156727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3516f1-eec7-4259-bc41-70210e540d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.158101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3516f1-eec7-4259-bc41-70210e540d5b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.176372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 586/1164] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:21:59.401377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536cd78-f7ff-479b-8294-71cd50847cb9 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:59.401959 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536cd78-f7ff-479b-8294-71cd50847cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:59.401959 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536cd78-f7ff-479b-8294-71cd50847cb9 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:59.403247 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 579/1165] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:59.408550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cc1b5-4fc5-4c93-b475-968555427e70 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:59.408999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cc1b5-4fc5-4c93-b475-968555427e70 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:59.409119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cc1b5-4fc5-4c93-b475-968555427e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:59.475408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0f9cc1b5-4fc5-4c93-b475-968555427e70 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:59.476596 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0f9cc1b5-4fc5-4c93-b475-968555427e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:59.528359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:59.579117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 587/1166] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:21:59.868823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536cd78-f7ff-479b-8294-71cd50847cb9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:59.870387 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6536cd78-f7ff-479b-8294-71cd50847cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:59.906502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:59.973822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536cd78-f7ff-479b-8294-71cd50847cb9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:00.052093 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda4b40-430c-483c-85cd-1fb58aa42029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:00.052695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4b40-430c-483c-85cd-1fb58aa42029 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:00.052968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4b40-430c-483c-85cd-1fb58aa42029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:00.053274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4b40-430c-483c-85cd-1fb58aa42029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:00.054861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aeda4b40-430c-483c-85cd-1fb58aa42029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:00.136381 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:00.167794 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda4b40-430c-483c-85cd-1fb58aa42029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:00.169337 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda4b40-430c-483c-85cd-1fb58aa42029 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:00.188903 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 580/1167] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:22:02.669955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d99f82-80ac-49b8-9721-b83cf5a05386 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.670507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d99f82-80ac-49b8-9721-b83cf5a05386 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.670507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d99f82-80ac-49b8-9721-b83cf5a05386 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.671872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 588/1168] 10.222.0.13 () {54 vars in 927 bytes} [Wed Nov 2 07:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:02.677108 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533d2f-97c7-422d-9e0c-937e2d0d43e9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.677544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533d2f-97c7-422d-9e0c-937e2d0d43e9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.677643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37533d2f-97c7-422d-9e0c-937e2d0d43e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.744524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-37533d2f-97c7-422d-9e0c-937e2d0d43e9 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:02.745754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-37533d2f-97c7-422d-9e0c-937e2d0d43e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:02.843729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 581/1169] 10.222.0.13 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:22:03.140784 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d99f82-80ac-49b8-9721-b83cf5a05386 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:03.142549 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f0d99f82-80ac-49b8-9721-b83cf5a05386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:03.244398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d99f82-80ac-49b8-9721-b83cf5a05386 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.318568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b3ee9-fe20-4347-a771-49d7fe900a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.319169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b3ee9-fe20-4347-a771-49d7fe900a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.319443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b3ee9-fe20-4347-a771-49d7fe900a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.319709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b3ee9-fe20-4347-a771-49d7fe900a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.321308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b04b3ee9-fe20-4347-a771-49d7fe900a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:03.329940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:03.430337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b3ee9-fe20-4347-a771-49d7fe900a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.431690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b3ee9-fe20-4347-a771-49d7fe900a93 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.449716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 589/1170] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:22:12.842223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=82 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.447486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=50 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.968042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae62be-f380-4795-9e2f-60d881300163 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.968596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae62be-f380-4795-9e2f-60d881300163 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.968596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae62be-f380-4795-9e2f-60d881300163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.046431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5bae62be-f380-4795-9e2f-60d881300163 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:16.047750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5bae62be-f380-4795-9e2f-60d881300163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:16.144677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 582/1171] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:23:16.152600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f94d1-f950-4402-88b6-499b9abd2e59 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.153128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f94d1-f950-4402-88b6-499b9abd2e59 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.153237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f94d1-f950-4402-88b6-499b9abd2e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.231060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a11f94d1-f950-4402-88b6-499b9abd2e59 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:16.232186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a11f94d1-f950-4402-88b6-499b9abd2e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:16.328248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 590/1172] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:23:16.332635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae62be-f380-4795-9e2f-60d881300163 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.333868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5bae62be-f380-4795-9e2f-60d881300163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:16.345369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae62be-f380-4795-9e2f-60d881300163 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.406390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.440207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.440808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.441120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.441392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.442034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:16.442333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.443341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:23:16.443341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: warnings.warn(msg) Nov 02 07:23:16.443341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: Nov 02 07:23:16.444212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.455904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 583/1173] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:16.465269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f94d1-f950-4402-88b6-499b9abd2e59 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.474923 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f94d1-f950-4402-88b6-499b9abd2e59 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.536128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.569903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6fe55-9b3c-476b-b0b8-5cb78828b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.570497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6fe55-9b3c-476b-b0b8-5cb78828b97d admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.570764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6fe55-9b3c-476b-b0b8-5cb78828b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.571023 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6fe55-9b3c-476b-b0b8-5cb78828b97d admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.571646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6fe55-9b3c-476b-b0b8-5cb78828b97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.572736 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-e6d6fe55-9b3c-476b-b0b8-5cb78828b97d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:23:16.572736 dv-cinder-804035-51-smb devstack@keystone.service[81559]: warnings.warn(msg) Nov 02 07:23:16.572736 dv-cinder-804035-51-smb devstack@keystone.service[81559]: Nov 02 07:23:16.573944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6fe55-9b3c-476b-b0b8-5cb78828b97d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.629732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 591/1174] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:23:16 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:16.633892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.635438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:16.668208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb94a3-0911-40b9-9aab-60ecf293686c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.762881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8024d6-854e-4184-98fb-386592414f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.763477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8024d6-854e-4184-98fb-386592414f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.763751 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8024d6-854e-4184-98fb-386592414f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.764018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8024d6-854e-4184-98fb-386592414f67 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.764803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8024d6-854e-4184-98fb-386592414f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.765832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-2d8024d6-854e-4184-98fb-386592414f67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:23:16.765832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: warnings.warn(msg) Nov 02 07:23:16.765832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: Nov 02 07:23:16.767061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8024d6-854e-4184-98fb-386592414f67 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.809063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 584/1175] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:16 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:16.813930 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6fe55-9b3c-476b-b0b8-5cb78828b97d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.815426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e6d6fe55-9b3c-476b-b0b8-5cb78828b97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:16.878220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6fe55-9b3c-476b-b0b8-5cb78828b97d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.961297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.972759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d419d-0ad6-4405-9106-49bbcccca586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.973394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d419d-0ad6-4405-9106-49bbcccca586 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.973663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d419d-0ad6-4405-9106-49bbcccca586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.973924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d419d-0ad6-4405-9106-49bbcccca586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.974551 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d419d-0ad6-4405-9106-49bbcccca586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.976121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d419d-0ad6-4405-9106-49bbcccca586 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.989798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 592/1176] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:16.994021 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8024d6-854e-4184-98fb-386592414f67 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.995566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2d8024d6-854e-4184-98fb-386592414f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:17.007042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8024d6-854e-4184-98fb-386592414f67 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.034068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.105534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7c6aa-c946-4f5f-84fa-794f68cd51ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.106133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7c6aa-c946-4f5f-84fa-794f68cd51ab admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.106401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7c6aa-c946-4f5f-84fa-794f68cd51ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.106663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7c6aa-c946-4f5f-84fa-794f68cd51ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.107285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7c6aa-c946-4f5f-84fa-794f68cd51ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.109655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7c6aa-c946-4f5f-84fa-794f68cd51ab admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.121704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 585/1177] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:17.125949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d419d-0ad6-4405-9106-49bbcccca586 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.127479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c19d419d-0ad6-4405-9106-49bbcccca586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:17.160676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d419d-0ad6-4405-9106-49bbcccca586 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.255180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1efc2-8fca-4741-ae00-a16c69bb911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.255824 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1efc2-8fca-4741-ae00-a16c69bb911f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.256099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1efc2-8fca-4741-ae00-a16c69bb911f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.256367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1efc2-8fca-4741-ae00-a16c69bb911f admin admin] PATH_INFO: `/v3/projects/8c329c8be807449db46be97608d83db6/users/9dade6b2b16842f99ab5e4aaa47db7bd/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.279538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1efc2-8fca-4741-ae00-a16c69bb911f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c329c8be807449db46be97608d83db6, user_id=9dade6b2b16842f99ab5e4aaa47db7bd, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.282856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1efc2-8fca-4741-ae00-a16c69bb911f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.306632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 593/1178] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:23:17 2022] PUT /identity/v3/projects/8c329c8be807449db46be97608d83db6/users/9dade6b2b16842f99ab5e4aaa47db7bd/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:17.317540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02ee91-64d9-4a06-a498-7f3f51b3d1d4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.317855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02ee91-64d9-4a06-a498-7f3f51b3d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.318134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02ee91-64d9-4a06-a498-7f3f51b3d1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.375534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3f02ee91-64d9-4a06-a498-7f3f51b3d1d4 None None] MFA Rules not processed for user `9dade6b2b16842f99ab5e4aaa47db7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:17.376671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3f02ee91-64d9-4a06-a498-7f3f51b3d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:17.456962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 586/1179] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:23:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:23:17.470038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7a1e6-4c8f-4ba1-bb70-5414479e36b4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.470317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7a1e6-4c8f-4ba1-bb70-5414479e36b4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.470614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7a1e6-4c8f-4ba1-bb70-5414479e36b4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.472213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 594/1180] 10.222.0.13 () {54 vars in 963 bytes} [Wed Nov 2 07:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:17.477246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2d6ba-d89b-41d3-82a6-f8f03a85142a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.477523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2d6ba-d89b-41d3-82a6-f8f03a85142a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.477789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2d6ba-d89b-41d3-82a6-f8f03a85142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.509339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.553562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-36a2d6ba-d89b-41d3-82a6-f8f03a85142a None None] MFA Rules not processed for user `2972059254094f8e909eb2adbb0b2257`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:17.554761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-36a2d6ba-d89b-41d3-82a6-f8f03a85142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:17.629234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 587/1181] 10.222.0.13 () {58 vars in 1060 bytes} [Wed Nov 2 07:23:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:23:17.636771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7a1e6-4c8f-4ba1-bb70-5414479e36b4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.638297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1fc7a1e6-4c8f-4ba1-bb70-5414479e36b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:17.688624 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.742776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7a1e6-4c8f-4ba1-bb70-5414479e36b4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.816361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a400d-c112-40dc-9dc7-5b19ddd9133d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.816949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a400d-c112-40dc-9dc7-5b19ddd9133d service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.817247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a400d-c112-40dc-9dc7-5b19ddd9133d service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.817513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a400d-c112-40dc-9dc7-5b19ddd9133d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.819078 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-272a400d-c112-40dc-9dc7-5b19ddd9133d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:17.917522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a400d-c112-40dc-9dc7-5b19ddd9133d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.918958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a400d-c112-40dc-9dc7-5b19ddd9133d service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.922400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.937823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 595/1182] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:23:17.983431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f446126-d31b-46e6-89e5-9cee33e70565 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.983870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f446126-d31b-46e6-89e5-9cee33e70565 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.984143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f446126-d31b-46e6-89e5-9cee33e70565 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.985431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 588/1183] 10.222.0.13 () {52 vars in 830 bytes} [Wed Nov 2 07:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:17.988937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a400d-c112-40dc-9dc7-5b19ddd9133d service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.990161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-272a400d-c112-40dc-9dc7-5b19ddd9133d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:18.090722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a400d-c112-40dc-9dc7-5b19ddd9133d service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.188791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.189462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.189738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.190036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] PATH_INFO: `/v3/users/9dade6b2b16842f99ab5e4aaa47db7bd` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.203866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dade6b2b16842f99ab5e4aaa47db7bd)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.204897 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:23:18.204897 dv-cinder-804035-51-smb devstack@keystone.service[81559]: warnings.warn(msg) Nov 02 07:23:18.204897 dv-cinder-804035-51-smb devstack@keystone.service[81559]: Nov 02 07:23:18.206142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.216143 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.273110 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dade6b2b16842f99ab5e4aaa47db7bd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:23:18.273637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dade6b2b16842f99ab5e4aaa47db7bd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:23:18.286911 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dade6b2b16842f99ab5e4aaa47db7bd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:23:18.287348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dade6b2b16842f99ab5e4aaa47db7bd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:23:18.310909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dade6b2b16842f99ab5e4aaa47db7bd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:23:18.326329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 596/1184] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:23:17 2022] DELETE /identity/v3/users/9dade6b2b16842f99ab5e4aaa47db7bd => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:18.330928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b1b45-b35f-4f60-b480-a91654820138 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.331403 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b1b45-b35f-4f60-b480-a91654820138 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.331497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b1b45-b35f-4f60-b480-a91654820138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.388049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4b7b1b45-b35f-4f60-b480-a91654820138 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:18.389261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4b7b1b45-b35f-4f60-b480-a91654820138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:18.464960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.478844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 589/1185] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:23:18.489187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.490464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:18.590383 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5507-a29e-4c31-8280-221746521b12 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.645126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.666021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6499d-399f-488b-9f1d-440e952dd5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.666621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6499d-399f-488b-9f1d-440e952dd5ba service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.666895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6499d-399f-488b-9f1d-440e952dd5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.667162 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6499d-399f-488b-9f1d-440e952dd5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.668746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-20a6499d-399f-488b-9f1d-440e952dd5ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:18.778641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6499d-399f-488b-9f1d-440e952dd5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.780579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6499d-399f-488b-9f1d-440e952dd5ba service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.798262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 597/1186] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:23:19.156243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b1b45-b35f-4f60-b480-a91654820138 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:19.157495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4b7b1b45-b35f-4f60-b480-a91654820138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:19.168491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b1b45-b35f-4f60-b480-a91654820138 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:19.264792 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:19.265571 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.265841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.266102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] PATH_INFO: `/v3/projects/8c329c8be807449db46be97608d83db6` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.275720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c329c8be807449db46be97608d83db6)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:19.276738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:23:19.276738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: warnings.warn(msg) Nov 02 07:23:19.276738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: Nov 02 07:23:19.277948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:19.336563 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c329c8be807449db46be97608d83db6', 'request_id': 'req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:23:19.347343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c329c8be807449db46be97608d83db6', 'request_id': 'req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:23:19.353509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c329c8be807449db46be97608d83db6', 'request_id': 'req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:23:19.383593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] The token cache is being invalidate because project 8c329c8be807449db46be97608d83db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:23:19.383881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:23:19.384398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1f985e1e-dfac-4431-b6f1-7fc76cebbe21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:23:19.385719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 590/1187] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:23:19 2022] DELETE /identity/v3/projects/8c329c8be807449db46be97608d83db6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:28.796202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=62 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:29.381676 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:50.085030 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ab2e4-d325-407d-96e3-19066bb886a0 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:50.085629 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ab2e4-d325-407d-96e3-19066bb886a0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:50.085629 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ab2e4-d325-407d-96e3-19066bb886a0 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:50.086976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 598/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:50.091787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f02644-2e8b-41c1-b160-95bedc64c59c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:50.092192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f02644-2e8b-41c1-b160-95bedc64c59c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:50.092330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f02644-2e8b-41c1-b160-95bedc64c59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:50.172145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-35f02644-2e8b-41c1-b160-95bedc64c59c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:50.173280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-35f02644-2e8b-41c1-b160-95bedc64c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:50.275369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 591/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:24:50.430692 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ab2e4-d325-407d-96e3-19066bb886a0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:50.432772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-414ab2e4-d325-407d-96e3-19066bb886a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:50.552190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ab2e4-d325-407d-96e3-19066bb886a0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:50.557588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f469f8-1f50-4ca5-a0d0-71cc01c68ace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:50.558280 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f469f8-1f50-4ca5-a0d0-71cc01c68ace service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:50.558560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f469f8-1f50-4ca5-a0d0-71cc01c68ace service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:50.558827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f469f8-1f50-4ca5-a0d0-71cc01c68ace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:50.566856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f469f8-1f50-4ca5-a0d0-71cc01c68ace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:50.568437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f469f8-1f50-4ca5-a0d0-71cc01c68ace service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:50.577828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 599/1190] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:24:51.644291 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ce78-8509-4c12-abaf-dd6196d9efe1 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.645501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ce78-8509-4c12-abaf-dd6196d9efe1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.645501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ce78-8509-4c12-abaf-dd6196d9efe1 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.646847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 592/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:51.651635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271df8-72f8-4359-ab76-e492403601ad None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.652108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271df8-72f8-4359-ab76-e492403601ad None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.652287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d271df8-72f8-4359-ab76-e492403601ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.672045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0d271df8-72f8-4359-ab76-e492403601ad None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:51.673264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0d271df8-72f8-4359-ab76-e492403601ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:51.682235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 600/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:24:51.837455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816ce78-8509-4c12-abaf-dd6196d9efe1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:51.852851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816ce78-8509-4c12-abaf-dd6196d9efe1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:51.858290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0054b49-56dd-443f-9c8a-e222744d8c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:51.858888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0054b49-56dd-443f-9c8a-e222744d8c0e service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:51.859146 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0054b49-56dd-443f-9c8a-e222744d8c0e service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:51.859490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0054b49-56dd-443f-9c8a-e222744d8c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:51.867970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0054b49-56dd-443f-9c8a-e222744d8c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:51.869629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0054b49-56dd-443f-9c8a-e222744d8c0e service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:51.878833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 593/1193] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:24:52.320545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adede3-269d-48fd-bf8c-bc0759c0e3c1 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:52.320834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adede3-269d-48fd-bf8c-bc0759c0e3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:52.321115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adede3-269d-48fd-bf8c-bc0759c0e3c1 None None] PATH_INFO: `/v3` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:52.322410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 601/1194] 10.222.0.43 () {54 vars in 925 bytes} [Wed Nov 2 07:24:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:24:52.330695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167552-289a-47d5-92c8-52e7b702a2f6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:52.330980 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167552-289a-47d5-92c8-52e7b702a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:52.331281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167552-289a-47d5-92c8-52e7b702a2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:52.395855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c4167552-289a-47d5-92c8-52e7b702a2f6 None None] MFA Rules not processed for user `55214b594a3f42ff8a7e0cecdef98937`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:52.397083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c4167552-289a-47d5-92c8-52e7b702a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:52.414022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:52.467804 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 594/1195] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Nov 2 07:24:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:24:56.116564 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f253504-6f8e-4180-9e26-eaea56fef753 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:56.117035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f253504-6f8e-4180-9e26-eaea56fef753 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:56.117144 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f253504-6f8e-4180-9e26-eaea56fef753 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:56.118455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 602/1196] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 07:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:56.123608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bde45-8002-48c7-b428-f3eb132bf5f7 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:56.124023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bde45-8002-48c7-b428-f3eb132bf5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:56.124156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bde45-8002-48c7-b428-f3eb132bf5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:56.146138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ab0bde45-8002-48c7-b428-f3eb132bf5f7 None None] MFA Rules not processed for user `55214b594a3f42ff8a7e0cecdef98937`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:56.147318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ab0bde45-8002-48c7-b428-f3eb132bf5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:56.155685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 595/1197] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 07:24:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:24:56.163244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f253504-6f8e-4180-9e26-eaea56fef753 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:56.176903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f253504-6f8e-4180-9e26-eaea56fef753 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:56.181940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f115597-03ec-40e0-8f9b-a32d6d1d6a8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:56.182521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f115597-03ec-40e0-8f9b-a32d6d1d6a8f service placement] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:56.182793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f115597-03ec-40e0-8f9b-a32d6d1d6a8f service placement] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:56.183060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f115597-03ec-40e0-8f9b-a32d6d1d6a8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:56.191226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f115597-03ec-40e0-8f9b-a32d6d1d6a8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:56.193317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f115597-03ec-40e0-8f9b-a32d6d1d6a8f service placement] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:56.202774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 603/1198] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:24:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:25:03.342205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e2235-43a0-4434-bfcd-901c65c600f9 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:03.342755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e2235-43a0-4434-bfcd-901c65c600f9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:03.342755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e2235-43a0-4434-bfcd-901c65c600f9 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:03.344089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 596/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:03.349330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d4702-4207-439d-8803-088b68177e72 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:03.349767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d4702-4207-439d-8803-088b68177e72 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:03.349879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d4702-4207-439d-8803-088b68177e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:03.369711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e58d4702-4207-439d-8803-088b68177e72 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:03.370909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e58d4702-4207-439d-8803-088b68177e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:03.378788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 604/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:25:03.531967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e2235-43a0-4434-bfcd-901c65c600f9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:03.546208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e2235-43a0-4434-bfcd-901c65c600f9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:03.552084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699b71d-2696-48ab-a9af-695e0a825ce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:03.552665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b71d-2696-48ab-a9af-695e0a825ce5 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:03.552936 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b71d-2696-48ab-a9af-695e0a825ce5 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:03.553236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b71d-2696-48ab-a9af-695e0a825ce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:03.561200 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699b71d-2696-48ab-a9af-695e0a825ce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:03.562803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699b71d-2696-48ab-a9af-695e0a825ce5 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:03.572874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 597/1201] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:25:04.624530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdebaf-691e-4dcd-abf6-499e5e5d09c4 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:04.625057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdebaf-691e-4dcd-abf6-499e5e5d09c4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:04.625151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdebaf-691e-4dcd-abf6-499e5e5d09c4 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:04.626460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 605/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:04.631625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1688951-d397-4ad1-beb5-e51435353229 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:04.632042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1688951-d397-4ad1-beb5-e51435353229 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:04.632162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1688951-d397-4ad1-beb5-e51435353229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:04.651567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a1688951-d397-4ad1-beb5-e51435353229 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:04.652729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a1688951-d397-4ad1-beb5-e51435353229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:04.660321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 598/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:25:04.811319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdebaf-691e-4dcd-abf6-499e5e5d09c4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:04.826471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdebaf-691e-4dcd-abf6-499e5e5d09c4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:04.831787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07198b7c-90e4-4c9b-9c50-6050b837b358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:04.832362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198b7c-90e4-4c9b-9c50-6050b837b358 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:04.832682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198b7c-90e4-4c9b-9c50-6050b837b358 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:04.832682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198b7c-90e4-4c9b-9c50-6050b837b358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:04.840749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07198b7c-90e4-4c9b-9c50-6050b837b358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:04.842330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07198b7c-90e4-4c9b-9c50-6050b837b358 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:04.851768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 606/1204] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:25:08.947704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96585-c17b-424c-8f44-c239cd47987e None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:08.948204 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96585-c17b-424c-8f44-c239cd47987e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:08.948299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96585-c17b-424c-8f44-c239cd47987e None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:08.949627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 599/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:08.954839 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b15d-edd8-4b52-ace1-2ad03c3a7497 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:08.955281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b15d-edd8-4b52-ace1-2ad03c3a7497 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:08.955391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14b15d-edd8-4b52-ace1-2ad03c3a7497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:08.975164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6b14b15d-edd8-4b52-ace1-2ad03c3a7497 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:08.976341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6b14b15d-edd8-4b52-ace1-2ad03c3a7497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:08.984065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 607/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:25:09.272649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d96585-c17b-424c-8f44-c239cd47987e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:09.274392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-29d96585-c17b-424c-8f44-c239cd47987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:09.351576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d96585-c17b-424c-8f44-c239cd47987e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:09.355103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c15a6-f323-445b-b0cd-b4d6d5d5e843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:09.355693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c15a6-f323-445b-b0cd-b4d6d5d5e843 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:09.355966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c15a6-f323-445b-b0cd-b4d6d5d5e843 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:09.356233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c15a6-f323-445b-b0cd-b4d6d5d5e843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:09.364930 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c15a6-f323-445b-b0cd-b4d6d5d5e843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:09.366386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c15a6-f323-445b-b0cd-b4d6d5d5e843 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:09.375386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 600/1207] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:25:11.523698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc195d0-fbd7-41ef-91c7-25ee8bec5c25 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:11.524235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc195d0-fbd7-41ef-91c7-25ee8bec5c25 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:11.524235 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc195d0-fbd7-41ef-91c7-25ee8bec5c25 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:11.525580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 608/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:11.530763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2ab0c-278d-4001-ab08-1c0efeb4ffab None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:11.531175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2ab0c-278d-4001-ab08-1c0efeb4ffab None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:11.531289 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2ab0c-278d-4001-ab08-1c0efeb4ffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:11.550400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-49c2ab0c-278d-4001-ab08-1c0efeb4ffab None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:11.552266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-49c2ab0c-278d-4001-ab08-1c0efeb4ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:11.559848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 601/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:25:11.845509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc195d0-fbd7-41ef-91c7-25ee8bec5c25 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:11.847488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dbc195d0-fbd7-41ef-91c7-25ee8bec5c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:11.861505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc195d0-fbd7-41ef-91c7-25ee8bec5c25 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:11.865848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84183c19-5ed3-47c7-b891-df2203606a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:11.866488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183c19-5ed3-47c7-b891-df2203606a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:11.866856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183c19-5ed3-47c7-b891-df2203606a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:11.867132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84183c19-5ed3-47c7-b891-df2203606a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:11.876063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84183c19-5ed3-47c7-b891-df2203606a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:11.877530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84183c19-5ed3-47c7-b891-df2203606a86 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:11.886943 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 609/1210] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:25:15.678153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced642d-e992-43e8-aab4-f8a8fab34d89 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:15.678701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced642d-e992-43e8-aab4-f8a8fab34d89 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:15.678701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced642d-e992-43e8-aab4-f8a8fab34d89 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:15.680011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 602/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:15.685260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb36c7e-59a6-43db-bd1d-b9d70a349468 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:15.685661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb36c7e-59a6-43db-bd1d-b9d70a349468 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:15.685806 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb36c7e-59a6-43db-bd1d-b9d70a349468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:15.704845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6fb36c7e-59a6-43db-bd1d-b9d70a349468 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:15.706068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6fb36c7e-59a6-43db-bd1d-b9d70a349468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:15.713916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 610/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:25:16.012707 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced642d-e992-43e8-aab4-f8a8fab34d89 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:16.014514 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fced642d-e992-43e8-aab4-f8a8fab34d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:16.078765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:16.092207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced642d-e992-43e8-aab4-f8a8fab34d89 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:16.095815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f1ceb-7803-4fcd-89ea-b3420febb36b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:16.096407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f1ceb-7803-4fcd-89ea-b3420febb36b service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:16.096678 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f1ceb-7803-4fcd-89ea-b3420febb36b service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:16.096942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f1ceb-7803-4fcd-89ea-b3420febb36b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:16.106050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f1ceb-7803-4fcd-89ea-b3420febb36b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:16.107478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f1ceb-7803-4fcd-89ea-b3420febb36b service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:16.117306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 603/1213] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:25:18.266344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e6f6d-ac6a-4743-a2bb-0f5820a5f562 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.266855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e6f6d-ac6a-4743-a2bb-0f5820a5f562 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.266855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e6f6d-ac6a-4743-a2bb-0f5820a5f562 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.268218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 611/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:25:18.273723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740ee5b-f3fc-4745-a329-d83a55df1c71 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.274204 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740ee5b-f3fc-4745-a329-d83a55df1c71 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.274309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740ee5b-f3fc-4745-a329-d83a55df1c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.294663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1740ee5b-f3fc-4745-a329-d83a55df1c71 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:18.295841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1740ee5b-f3fc-4745-a329-d83a55df1c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:18.304352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 604/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:25:18.600527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e6f6d-ac6a-4743-a2bb-0f5820a5f562 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:18.602123 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1e0e6f6d-ac6a-4743-a2bb-0f5820a5f562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:18.616547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e6f6d-ac6a-4743-a2bb-0f5820a5f562 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:18.620335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fef2cd-1c37-4916-b793-3ab8b5be513c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:18.620929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fef2cd-1c37-4916-b793-3ab8b5be513c service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:18.621228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fef2cd-1c37-4916-b793-3ab8b5be513c service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:18.621502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fef2cd-1c37-4916-b793-3ab8b5be513c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:18.630482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fef2cd-1c37-4916-b793-3ab8b5be513c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:18.631890 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fef2cd-1c37-4916-b793-3ab8b5be513c service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:18.641243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 612/1216] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:25:28.289776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=11 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:28.637024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:45.245129 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbbfe6-7b80-4c29-b08a-c75edd7936be None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.245735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbbfe6-7b80-4c29-b08a-c75edd7936be None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.245735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbbfe6-7b80-4c29-b08a-c75edd7936be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.273055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-27fbbfe6-7b80-4c29-b08a-c75edd7936be None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:45.274273 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-27fbbfe6-7b80-4c29-b08a-c75edd7936be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:45.286173 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 605/1217] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:45.298802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10571a-dfaa-44d9-86e9-c62832ab83c6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.299830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10571a-dfaa-44d9-86e9-c62832ab83c6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.300333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10571a-dfaa-44d9-86e9-c62832ab83c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.325983 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-bf10571a-dfaa-44d9-86e9-c62832ab83c6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:45.327604 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bf10571a-dfaa-44d9-86e9-c62832ab83c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:45.340822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 613/1218] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:45.345754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbbfe6-7b80-4c29-b08a-c75edd7936be None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:45.356584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbbfe6-7b80-4c29-b08a-c75edd7936be None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:45.368345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e311f6-5896-4d54-adad-05c9afb290a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:45.368961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e311f6-5896-4d54-adad-05c9afb290a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.369266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e311f6-5896-4d54-adad-05c9afb290a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.369537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e311f6-5896-4d54-adad-05c9afb290a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.370185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e311f6-5896-4d54-adad-05c9afb290a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:45.370485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e311f6-5896-4d54-adad-05c9afb290a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:45.372248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e311f6-5896-4d54-adad-05c9afb290a7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:45.390497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 606/1219] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:45.400186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10571a-dfaa-44d9-86e9-c62832ab83c6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:45.415238 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10571a-dfaa-44d9-86e9-c62832ab83c6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:45.420596 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363417d7-fab5-420a-a29b-a397acc36d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:45.422193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363417d7-fab5-420a-a29b-a397acc36d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.422716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363417d7-fab5-420a-a29b-a397acc36d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.423212 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363417d7-fab5-420a-a29b-a397acc36d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.424066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363417d7-fab5-420a-a29b-a397acc36d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:45.426859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363417d7-fab5-420a-a29b-a397acc36d04 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:45.486009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 614/1220] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:45 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:45.487739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e311f6-5896-4d54-adad-05c9afb290a7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:45.502981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e311f6-5896-4d54-adad-05c9afb290a7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:45.594168 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269fc3b-7a4a-4577-b4a1-414be1363fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:45.594797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269fc3b-7a4a-4577-b4a1-414be1363fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.595075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269fc3b-7a4a-4577-b4a1-414be1363fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.595355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269fc3b-7a4a-4577-b4a1-414be1363fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.596007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269fc3b-7a4a-4577-b4a1-414be1363fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:45.599142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269fc3b-7a4a-4577-b4a1-414be1363fd1 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:45.628173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8144e27-fc12-4545-8459-5fe73b47aff0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.628876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8144e27-fc12-4545-8459-5fe73b47aff0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.629442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8144e27-fc12-4545-8459-5fe73b47aff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.644738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 607/1221] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:45 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:45.649945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269fc3b-7a4a-4577-b4a1-414be1363fd1 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:45.662452 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e8144e27-fc12-4545-8459-5fe73b47aff0 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:45.664370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e8144e27-fc12-4545-8459-5fe73b47aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:45.666266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269fc3b-7a4a-4577-b4a1-414be1363fd1 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:45.675278 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 615/1222] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:45.679552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ca44c-ab8f-4c42-a802-ed394b912285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:45.680625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ca44c-ab8f-4c42-a802-ed394b912285 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.681174 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ca44c-ab8f-4c42-a802-ed394b912285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.681681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ca44c-ab8f-4c42-a802-ed394b912285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.682593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ca44c-ab8f-4c42-a802-ed394b912285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:45.685085 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad14e-df5f-4c7b-b804-c6e582dd71de None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.685713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad14e-df5f-4c7b-b804-c6e582dd71de None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.686242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad14e-df5f-4c7b-b804-c6e582dd71de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.691258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ca44c-ab8f-4c42-a802-ed394b912285 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:45.724128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 608/1223] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:45.725540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ca44c-ab8f-4c42-a802-ed394b912285 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:45.735387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-77fad14e-df5f-4c7b-b804-c6e582dd71de None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:45.737060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-77fad14e-df5f-4c7b-b804-c6e582dd71de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:45.746851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ca44c-ab8f-4c42-a802-ed394b912285 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:45.756389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 616/1224] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:26:45.758738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd2c96-0938-4d96-9a54-59d19b628b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:45.759638 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2c96-0938-4d96-9a54-59d19b628b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.760133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2c96-0938-4d96-9a54-59d19b628b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.760629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2c96-0938-4d96-9a54-59d19b628b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.762498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fad14e-df5f-4c7b-b804-c6e582dd71de None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:45.765041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd2c96-0938-4d96-9a54-59d19b628b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:45.769192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd2c96-0938-4d96-9a54-59d19b628b77 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:45.777981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fad14e-df5f-4c7b-b804-c6e582dd71de None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:45.790487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 609/1225] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:45.794118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f1b0d-a652-498c-803a-78f57c1bdf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:45.795086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f1b0d-a652-498c-803a-78f57c1bdf2a admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.796375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd2c96-0938-4d96-9a54-59d19b628b77 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:45.796910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f1b0d-a652-498c-803a-78f57c1bdf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.797921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f1b0d-a652-498c-803a-78f57c1bdf2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.798840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f1b0d-a652-498c-803a-78f57c1bdf2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:45.802561 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f1b0d-a652-498c-803a-78f57c1bdf2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:45.804014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-6b4f1b0d-a652-498c-803a-78f57c1bdf2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:26:45.804014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: warnings.warn(msg) Nov 02 07:26:45.804014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: Nov 02 07:26:45.805325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f1b0d-a652-498c-803a-78f57c1bdf2a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:45.822636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd2c96-0938-4d96-9a54-59d19b628b77 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:45.835511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67f588-9df1-4b4e-bd4b-60fdd35ac9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:45.836319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 617/1226] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:45.837421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67f588-9df1-4b4e-bd4b-60fdd35ac9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.837934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67f588-9df1-4b4e-bd4b-60fdd35ac9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.839042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67f588-9df1-4b4e-bd4b-60fdd35ac9f2 admin admin] PATH_INFO: `/v3/projects/608ff9d8e9814608b54e3c451f317e2f/users/78bec0414d064ed8901271fc4c57cfe5/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.847716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f1b0d-a652-498c-803a-78f57c1bdf2a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:45.871298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f1b0d-a652-498c-803a-78f57c1bdf2a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:45.884411 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff23c2-20da-4450-a5cd-ba4a7fbe2199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:45.885648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67f588-9df1-4b4e-bd4b-60fdd35ac9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608ff9d8e9814608b54e3c451f317e2f, user_id=78bec0414d064ed8901271fc4c57cfe5, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:45.886532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff23c2-20da-4450-a5cd-ba4a7fbe2199 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.889578 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67f588-9df1-4b4e-bd4b-60fdd35ac9f2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:45.890556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff23c2-20da-4450-a5cd-ba4a7fbe2199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.891671 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff23c2-20da-4450-a5cd-ba4a7fbe2199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.892611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff23c2-20da-4450-a5cd-ba4a7fbe2199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:45.895553 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff23c2-20da-4450-a5cd-ba4a7fbe2199 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:45.946456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 610/1227] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:45 2022] PUT /identity/v3/projects/608ff9d8e9814608b54e3c451f317e2f/users/78bec0414d064ed8901271fc4c57cfe5/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:45.948150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae838-3813-4821-bede-c5fdd87108d3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.948920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae838-3813-4821-bede-c5fdd87108d3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.949685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae838-3813-4821-bede-c5fdd87108d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.974926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 618/1228] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:45 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:45.976220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09ea1b-820c-4a72-b3a8-52c35eb1123b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:45.976506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09ea1b-820c-4a72-b3a8-52c35eb1123b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:45.976773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09ea1b-820c-4a72-b3a8-52c35eb1123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:45.981266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-590ae838-3813-4821-bede-c5fdd87108d3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:45.982750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-590ae838-3813-4821-bede-c5fdd87108d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.023961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5e09ea1b-820c-4a72-b3a8-52c35eb1123b None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.028442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5e09ea1b-820c-4a72-b3a8-52c35eb1123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.114844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 611/1229] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.116042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ae838-3813-4821-bede-c5fdd87108d3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.136126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ae838-3813-4821-bede-c5fdd87108d3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.144493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 619/1230] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.146181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8441-9b10-4a4c-a909-7c436c54b3b3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.146467 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8441-9b10-4a4c-a909-7c436c54b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.146777 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8441-9b10-4a4c-a909-7c436c54b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.148595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d9c92-58a7-43f4-9cfb-a8c6bf662eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.149299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d9c92-58a7-43f4-9cfb-a8c6bf662eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.149573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d9c92-58a7-43f4-9cfb-a8c6bf662eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.149827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d9c92-58a7-43f4-9cfb-a8c6bf662eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.150511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d9c92-58a7-43f4-9cfb-a8c6bf662eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.152585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d9c92-58a7-43f4-9cfb-a8c6bf662eb5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.176968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0a8c8441-9b10-4a4c-a909-7c436c54b3b3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.179015 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0a8c8441-9b10-4a4c-a909-7c436c54b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.182840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 612/1231] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/users => generated 303 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:46.184299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd771f81-03a6-4e43-887d-c2db1f334abf None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.184744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd771f81-03a6-4e43-887d-c2db1f334abf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.185195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd771f81-03a6-4e43-887d-c2db1f334abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.189612 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 620/1232] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.191352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1d530-3a5d-4e5d-974f-706ce11bfb01 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.192573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1d530-3a5d-4e5d-974f-706ce11bfb01 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.193177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1d530-3a5d-4e5d-974f-706ce11bfb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.212748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:46.218183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-89f1d530-3a5d-4e5d-974f-706ce11bfb01 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.218629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-fd771f81-03a6-4e43-887d-c2db1f334abf None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.219430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-89f1d530-3a5d-4e5d-974f-706ce11bfb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.220438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fd771f81-03a6-4e43-887d-c2db1f334abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.228026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 621/1233] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.228978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 613/1234] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.229372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57da48-1e64-426a-8790-a07eff5dd90d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.229731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57da48-1e64-426a-8790-a07eff5dd90d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.230615 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57da48-1e64-426a-8790-a07eff5dd90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.233971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd771f81-03a6-4e43-887d-c2db1f334abf None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.251785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-fa57da48-1e64-426a-8790-a07eff5dd90d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.252957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fa57da48-1e64-426a-8790-a07eff5dd90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.261602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 622/1235] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.262377 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57da48-1e64-426a-8790-a07eff5dd90d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.273061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57da48-1e64-426a-8790-a07eff5dd90d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.277920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a5322-aba6-4754-ad93-4d013e436b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.278448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5322-aba6-4754-ad93-4d013e436b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.278719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5322-aba6-4754-ad93-4d013e436b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.278984 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a5322-aba6-4754-ad93-4d013e436b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.279610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5322-aba6-4754-ad93-4d013e436b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.281228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a5322-aba6-4754-ad93-4d013e436b8f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.292195 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 623/1236] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:46.293401 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dada3e2-b3ba-430e-a498-b52a9399d3dc None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.293680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dada3e2-b3ba-430e-a498-b52a9399d3dc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.293950 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dada3e2-b3ba-430e-a498-b52a9399d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.294402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd771f81-03a6-4e43-887d-c2db1f334abf None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.298096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0823b02-f7a3-4055-97e5-5d95c89c8af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.298699 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0823b02-f7a3-4055-97e5-5d95c89c8af8 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.298975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0823b02-f7a3-4055-97e5-5d95c89c8af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.299245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0823b02-f7a3-4055-97e5-5d95c89c8af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.309339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0823b02-f7a3-4055-97e5-5d95c89c8af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.310771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0823b02-f7a3-4055-97e5-5d95c89c8af8 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.313600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0dada3e2-b3ba-430e-a498-b52a9399d3dc None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.314787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0dada3e2-b3ba-430e-a498-b52a9399d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.320611 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 614/1237] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:46.322917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc014d-f8db-44e0-97a3-f6a085473c80 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.322917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc014d-f8db-44e0-97a3-f6a085473c80 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.322917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc014d-f8db-44e0-97a3-f6a085473c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.324672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 624/1238] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.329261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ac42-7f19-40d4-b8a3-0865dce75273 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.329261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ac42-7f19-40d4-b8a3-0865dce75273 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.329261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ac42-7f19-40d4-b8a3-0865dce75273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.350442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e0fc014d-f8db-44e0-97a3-f6a085473c80 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.350847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3f97ac42-7f19-40d4-b8a3-0865dce75273 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.351941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e0fc014d-f8db-44e0-97a3-f6a085473c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.352106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3f97ac42-7f19-40d4-b8a3-0865dce75273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.360510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 625/1240] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.360689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 615/1240] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.361442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc014d-f8db-44e0-97a3-f6a085473c80 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.361787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee392df-573a-4f6e-9ba8-6ed2caebb392 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.362065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee392df-573a-4f6e-9ba8-6ed2caebb392 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.362338 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee392df-573a-4f6e-9ba8-6ed2caebb392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.380131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc014d-f8db-44e0-97a3-f6a085473c80 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.383775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6ee392df-573a-4f6e-9ba8-6ed2caebb392 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.385102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2e3a-d404-4605-890b-515022896367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.385262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6ee392df-573a-4f6e-9ba8-6ed2caebb392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.386087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2e3a-d404-4605-890b-515022896367 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.386962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2e3a-d404-4605-890b-515022896367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.386962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2e3a-d404-4605-890b-515022896367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.387428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2e3a-d404-4605-890b-515022896367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:46.387724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2e3a-d404-4605-890b-515022896367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.389340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2e3a-d404-4605-890b-515022896367 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.394708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 626/1241] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.396046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d704d-c6d7-4ead-802e-1448a82f85f7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.396398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d704d-c6d7-4ead-802e-1448a82f85f7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.396865 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d704d-c6d7-4ead-802e-1448a82f85f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.408170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 616/1242] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:46.409766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2e3a-d404-4605-890b-515022896367 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.423390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2e3a-d404-4605-890b-515022896367 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.424568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-993d704d-c6d7-4ead-802e-1448a82f85f7 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.425895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-993d704d-c6d7-4ead-802e-1448a82f85f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.430233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851353a4-c6a3-4dfa-a488-bfb74e18ad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.430863 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851353a4-c6a3-4dfa-a488-bfb74e18ad18 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.431191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851353a4-c6a3-4dfa-a488-bfb74e18ad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.431462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851353a4-c6a3-4dfa-a488-bfb74e18ad18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.432111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851353a4-c6a3-4dfa-a488-bfb74e18ad18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.433743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851353a4-c6a3-4dfa-a488-bfb74e18ad18 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.436574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 627/1243] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.440460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada9cb-db99-4201-a831-f78794f7f390 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.440460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada9cb-db99-4201-a831-f78794f7f390 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.440460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada9cb-db99-4201-a831-f78794f7f390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.450604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 617/1244] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:46.450604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851353a4-c6a3-4dfa-a488-bfb74e18ad18 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.460432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851353a4-c6a3-4dfa-a488-bfb74e18ad18 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.463593 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6eada9cb-db99-4201-a831-f78794f7f390 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.464868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6eada9cb-db99-4201-a831-f78794f7f390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.465623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cb810-07cb-44f0-a58c-9d01dfef1b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.466390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cb810-07cb-44f0-a58c-9d01dfef1b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.466750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cb810-07cb-44f0-a58c-9d01dfef1b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.467123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cb810-07cb-44f0-a58c-9d01dfef1b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.467900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cb810-07cb-44f0-a58c-9d01dfef1b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:46.468303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cb810-07cb-44f0-a58c-9d01dfef1b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.470027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0cb810-07cb-44f0-a58c-9d01dfef1b51 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.478117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 628/1245] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.478117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8acf16-b2b8-4560-a422-dfb463b7a763 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.478117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8acf16-b2b8-4560-a422-dfb463b7a763 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.478117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8acf16-b2b8-4560-a422-dfb463b7a763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.491489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 618/1246] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:46.492394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cb810-07cb-44f0-a58c-9d01dfef1b51 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.504828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cb810-07cb-44f0-a58c-9d01dfef1b51 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.508279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-be8acf16-b2b8-4560-a422-dfb463b7a763 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:46.509519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-be8acf16-b2b8-4560-a422-dfb463b7a763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:46.510310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874b856-90a4-45e3-9fcd-12cd706a577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.511036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b856-90a4-45e3-9fcd-12cd706a577a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.511416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b856-90a4-45e3-9fcd-12cd706a577a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.511790 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874b856-90a4-45e3-9fcd-12cd706a577a admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.512537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874b856-90a4-45e3-9fcd-12cd706a577a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:46.512950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874b856-90a4-45e3-9fcd-12cd706a577a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.514661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874b856-90a4-45e3-9fcd-12cd706a577a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.518221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 629/1247] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:46.518791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8acf16-b2b8-4560-a422-dfb463b7a763 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.525722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:46.529959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8acf16-b2b8-4560-a422-dfb463b7a763 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.536582 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 619/1248] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:46.537826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874b856-90a4-45e3-9fcd-12cd706a577a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.537966 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535a794-1de0-4bcc-8d96-33c5b068e877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.538689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535a794-1de0-4bcc-8d96-33c5b068e877 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.539075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535a794-1de0-4bcc-8d96-33c5b068e877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.539438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535a794-1de0-4bcc-8d96-33c5b068e877 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.540189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535a794-1de0-4bcc-8d96-33c5b068e877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.542270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535a794-1de0-4bcc-8d96-33c5b068e877 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.552248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874b856-90a4-45e3-9fcd-12cd706a577a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.557883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2661102-27ea-40c6-a03e-d7f75a1d1985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.558485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2661102-27ea-40c6-a03e-d7f75a1d1985 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.558762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2661102-27ea-40c6-a03e-d7f75a1d1985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.559034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2661102-27ea-40c6-a03e-d7f75a1d1985 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.559728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2661102-27ea-40c6-a03e-d7f75a1d1985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:46.560032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2661102-27ea-40c6-a03e-d7f75a1d1985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.561910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2661102-27ea-40c6-a03e-d7f75a1d1985 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.577411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 620/1249] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:46.578729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2661102-27ea-40c6-a03e-d7f75a1d1985 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.579803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 630/1250] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:46.580735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535a794-1de0-4bcc-8d96-33c5b068e877 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.602078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2661102-27ea-40c6-a03e-d7f75a1d1985 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.671673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c53444-00d2-4223-9f7f-f3b798b56f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.672715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53444-00d2-4223-9f7f-f3b798b56f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.673239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53444-00d2-4223-9f7f-f3b798b56f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.673713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53444-00d2-4223-9f7f-f3b798b56f8e admin admin] PATH_INFO: `/v3/projects/58af4307f4bb48b6bdaeb336992aa171/users/7c0fbba3e7574f678bd6afb800382c6f/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.675035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535a794-1de0-4bcc-8d96-33c5b068e877 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.680501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38866ab-1190-42a0-a7d9-39d1600b2fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.681149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38866ab-1190-42a0-a7d9-39d1600b2fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.681426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38866ab-1190-42a0-a7d9-39d1600b2fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.681696 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38866ab-1190-42a0-a7d9-39d1600b2fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.682339 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38866ab-1190-42a0-a7d9-39d1600b2fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:46.682641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38866ab-1190-42a0-a7d9-39d1600b2fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.684237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38866ab-1190-42a0-a7d9-39d1600b2fa2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.694177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c53444-00d2-4223-9f7f-f3b798b56f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58af4307f4bb48b6bdaeb336992aa171, user_id=7c0fbba3e7574f678bd6afb800382c6f, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.697463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c53444-00d2-4223-9f7f-f3b798b56f8e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.698039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 631/1251] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:46.705883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38866ab-1190-42a0-a7d9-39d1600b2fa2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.713821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 621/1252] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:46 2022] PUT /identity/v3/projects/58af4307f4bb48b6bdaeb336992aa171/users/7c0fbba3e7574f678bd6afb800382c6f/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:46.715004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c53444-00d2-4223-9f7f-f3b798b56f8e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.716377 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38866ab-1190-42a0-a7d9-39d1600b2fa2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.735978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:46.787469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f367ef-05f5-4a53-91d3-a48d566d67a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.788422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f367ef-05f5-4a53-91d3-a48d566d67a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.789003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f367ef-05f5-4a53-91d3-a48d566d67a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.789515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f367ef-05f5-4a53-91d3-a48d566d67a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.790454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f367ef-05f5-4a53-91d3-a48d566d67a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.792688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f367ef-05f5-4a53-91d3-a48d566d67a6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.797459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c53444-00d2-4223-9f7f-f3b798b56f8e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.808708 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1b1de-053d-4482-bcab-64a44c9f22b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.809039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1b1de-053d-4482-bcab-64a44c9f22b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.809321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1b1de-053d-4482-bcab-64a44c9f22b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.809595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1b1de-053d-4482-bcab-64a44c9f22b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.811719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1b1de-053d-4482-bcab-64a44c9f22b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:46.812213 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1b1de-053d-4482-bcab-64a44c9f22b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.814141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1b1de-053d-4482-bcab-64a44c9f22b4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.827995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 632/1253] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:46.828841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f367ef-05f5-4a53-91d3-a48d566d67a6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.831344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 622/1254] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:46.832882 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1b1de-053d-4482-bcab-64a44c9f22b4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.843867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1b1de-053d-4482-bcab-64a44c9f22b4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.914963 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f367ef-05f5-4a53-91d3-a48d566d67a6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.916492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279eba-0c48-4d49-bb21-b3a456103fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.917215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279eba-0c48-4d49-bb21-b3a456103fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.917499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279eba-0c48-4d49-bb21-b3a456103fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.917773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279eba-0c48-4d49-bb21-b3a456103fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.918409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6279eba-0c48-4d49-bb21-b3a456103fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.920302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec341b-591b-44fa-ad0c-049161f97fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.920444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6279eba-0c48-4d49-bb21-b3a456103fd0 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.920910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec341b-591b-44fa-ad0c-049161f97fce admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.921214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec341b-591b-44fa-ad0c-049161f97fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.921484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec341b-591b-44fa-ad0c-049161f97fce admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.922105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec341b-591b-44fa-ad0c-049161f97fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.923997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec341b-591b-44fa-ad0c-049161f97fce admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:46.930472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:46.949610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 623/1255] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:46.949610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279eba-0c48-4d49-bb21-b3a456103fd0 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.958865 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279eba-0c48-4d49-bb21-b3a456103fd0 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:46.966790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 633/1256] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:46.966969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720f8a5-80aa-407a-a5af-e47576d198ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:46.967098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec341b-591b-44fa-ad0c-049161f97fce admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:46.967195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720f8a5-80aa-407a-a5af-e47576d198ca admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:46.967195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720f8a5-80aa-407a-a5af-e47576d198ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:46.967195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720f8a5-80aa-407a-a5af-e47576d198ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:46.967195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720f8a5-80aa-407a-a5af-e47576d198ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:46.967542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-f720f8a5-80aa-407a-a5af-e47576d198ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:26:46.967542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: warnings.warn(msg) Nov 02 07:26:46.967542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: Nov 02 07:26:46.968630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720f8a5-80aa-407a-a5af-e47576d198ca admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.003932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 624/1257] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:47.003932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac09853-49ac-4995-a7a7-0c03ad1d65a3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.003932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac09853-49ac-4995-a7a7-0c03ad1d65a3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.003932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac09853-49ac-4995-a7a7-0c03ad1d65a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.025083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cac09853-49ac-4995-a7a7-0c03ad1d65a3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:47.027360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cac09853-49ac-4995-a7a7-0c03ad1d65a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:47.048658 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec341b-591b-44fa-ad0c-049161f97fce admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.113164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 625/1258] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:47.115428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac09853-49ac-4995-a7a7-0c03ad1d65a3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.118315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefc714-30e0-446e-b417-c86b615de395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.119049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefc714-30e0-446e-b417-c86b615de395 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.119393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefc714-30e0-446e-b417-c86b615de395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.119729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefc714-30e0-446e-b417-c86b615de395 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.120425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefc714-30e0-446e-b417-c86b615de395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.122463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefc714-30e0-446e-b417-c86b615de395 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.128415 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac09853-49ac-4995-a7a7-0c03ad1d65a3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.133470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8e0b5-dba8-41f0-810d-10c49945bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.134099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8e0b5-dba8-41f0-810d-10c49945bda3 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.134887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8e0b5-dba8-41f0-810d-10c49945bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.134887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8e0b5-dba8-41f0-810d-10c49945bda3 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.135413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8e0b5-dba8-41f0-810d-10c49945bda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.137394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8e0b5-dba8-41f0-810d-10c49945bda3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.157137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:47.164619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 634/1259] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:46 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:47.164619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefc714-30e0-446e-b417-c86b615de395 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.167674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 626/1260] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:47 2022] POST /identity/v3/users => generated 283 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:47.168848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8e0b5-dba8-41f0-810d-10c49945bda3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.180149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8e0b5-dba8-41f0-810d-10c49945bda3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.248015 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefc714-30e0-446e-b417-c86b615de395 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.255399 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548cf15-2256-458e-8a23-7493f9747f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.256025 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548cf15-2256-458e-8a23-7493f9747f5b admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.256305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548cf15-2256-458e-8a23-7493f9747f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.256580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548cf15-2256-458e-8a23-7493f9747f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.257318 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548cf15-2256-458e-8a23-7493f9747f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.259274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12a78d-14f6-44a4-be79-1520dfac2248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.259417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548cf15-2256-458e-8a23-7493f9747f5b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.260083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12a78d-14f6-44a4-be79-1520dfac2248 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.260460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12a78d-14f6-44a4-be79-1520dfac2248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.260828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12a78d-14f6-44a4-be79-1520dfac2248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.261618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12a78d-14f6-44a4-be79-1520dfac2248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.263300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12a78d-14f6-44a4-be79-1520dfac2248 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.276632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 627/1261] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.280816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12a78d-14f6-44a4-be79-1520dfac2248 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.294970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12a78d-14f6-44a4-be79-1520dfac2248 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.304987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a03efd-b87b-4b47-a53b-a15f2ab26da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.304987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a03efd-b87b-4b47-a53b-a15f2ab26da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.304987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a03efd-b87b-4b47-a53b-a15f2ab26da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.304987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a03efd-b87b-4b47-a53b-a15f2ab26da3 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.305556 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a03efd-b87b-4b47-a53b-a15f2ab26da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.305556 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a03efd-b87b-4b47-a53b-a15f2ab26da3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.306421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 635/1262] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:47 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:47.307493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548cf15-2256-458e-8a23-7493f9747f5b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.317810 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:47.337799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 628/1263] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:47 2022] POST /identity/v3/users => generated 287 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:47.338857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a03efd-b87b-4b47-a53b-a15f2ab26da3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.393725 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548cf15-2256-458e-8a23-7493f9747f5b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.400017 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0d471-7e65-40fa-915e-24a79ef269e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.400633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0d471-7e65-40fa-915e-24a79ef269e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.401106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0d471-7e65-40fa-915e-24a79ef269e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.401390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0d471-7e65-40fa-915e-24a79ef269e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.402079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0d471-7e65-40fa-915e-24a79ef269e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.403243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-26b0d471-7e65-40fa-915e-24a79ef269e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:26:47.403243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: warnings.warn(msg) Nov 02 07:26:47.403243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: Nov 02 07:26:47.404482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0d471-7e65-40fa-915e-24a79ef269e9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.429095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a03efd-b87b-4b47-a53b-a15f2ab26da3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.435388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 636/1264] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:47 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:47.435388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0d471-7e65-40fa-915e-24a79ef269e9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.446386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0d471-7e65-40fa-915e-24a79ef269e9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.456245 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb34d8-4328-43af-9dca-4f800e51f66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.456863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb34d8-4328-43af-9dca-4f800e51f66a admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.458792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb34d8-4328-43af-9dca-4f800e51f66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.459078 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb34d8-4328-43af-9dca-4f800e51f66a admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.460034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb34d8-4328-43af-9dca-4f800e51f66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.462020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb34d8-4328-43af-9dca-4f800e51f66a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.494696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcec41-1980-499d-89c7-146b87d67698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.495539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcec41-1980-499d-89c7-146b87d67698 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.495988 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcec41-1980-499d-89c7-146b87d67698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.496459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcec41-1980-499d-89c7-146b87d67698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.507811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 637/1265] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:47 2022] POST /identity/v3/users => generated 283 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:47.508663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb34d8-4328-43af-9dca-4f800e51f66a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.510551 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcec41-1980-499d-89c7-146b87d67698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.512216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcec41-1980-499d-89c7-146b87d67698 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.519226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb34d8-4328-43af-9dca-4f800e51f66a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.524668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 629/1266] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:47.525152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b9ace-4025-45ce-a1f1-d8b77f36cce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.525903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9ace-4025-45ce-a1f1-d8b77f36cce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.526193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9ace-4025-45ce-a1f1-d8b77f36cce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.526600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b9ace-4025-45ce-a1f1-d8b77f36cce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.526851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcec41-1980-499d-89c7-146b87d67698 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.527246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b9ace-4025-45ce-a1f1-d8b77f36cce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.528921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b9ace-4025-45ce-a1f1-d8b77f36cce4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.542461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcec41-1980-499d-89c7-146b87d67698 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.543364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 638/1267] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.544230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b9ace-4025-45ce-a1f1-d8b77f36cce4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.557627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e951cc-b0cd-4238-bfc4-b558ab0e9e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.558183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e951cc-b0cd-4238-bfc4-b558ab0e9e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.558462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e951cc-b0cd-4238-bfc4-b558ab0e9e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.558732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e951cc-b0cd-4238-bfc4-b558ab0e9e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.559369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e951cc-b0cd-4238-bfc4-b558ab0e9e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.560984 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e951cc-b0cd-4238-bfc4-b558ab0e9e58 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.561119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b9ace-4025-45ce-a1f1-d8b77f36cce4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.573133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f761caa-89ff-471b-9caa-7c167eb54f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.574643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 630/1268] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.575617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f761caa-89ff-471b-9caa-7c167eb54f33 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.575762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e951cc-b0cd-4238-bfc4-b558ab0e9e58 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.576513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f761caa-89ff-471b-9caa-7c167eb54f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.576985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f761caa-89ff-471b-9caa-7c167eb54f33 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.578069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f761caa-89ff-471b-9caa-7c167eb54f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.582766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f761caa-89ff-471b-9caa-7c167eb54f33 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.588958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e951cc-b0cd-4238-bfc4-b558ab0e9e58 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.595470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a1a2c-3d11-4ad2-b581-0235a60c387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.596152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a1a2c-3d11-4ad2-b581-0235a60c387f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.596422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a1a2c-3d11-4ad2-b581-0235a60c387f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.596734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a1a2c-3d11-4ad2-b581-0235a60c387f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.598733 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a1a2c-3d11-4ad2-b581-0235a60c387f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.600904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a1a2c-3d11-4ad2-b581-0235a60c387f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.616445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 639/1269] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:47 2022] POST /identity/v3/users => generated 297 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:47.617887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f761caa-89ff-471b-9caa-7c167eb54f33 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.620744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 631/1270] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.621931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a1a2c-3d11-4ad2-b581-0235a60c387f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.635979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f761caa-89ff-471b-9caa-7c167eb54f33 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.639407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a1a2c-3d11-4ad2-b581-0235a60c387f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.644151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683088bb-80af-4ede-bc87-392f0e46963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.645748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683088bb-80af-4ede-bc87-392f0e46963a admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.646493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683088bb-80af-4ede-bc87-392f0e46963a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.647031 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683088bb-80af-4ede-bc87-392f0e46963a admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.648348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918631b-72a2-4a33-834f-9961580da61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.648727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683088bb-80af-4ede-bc87-392f0e46963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.650513 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918631b-72a2-4a33-834f-9961580da61d admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.651112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918631b-72a2-4a33-834f-9961580da61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.651255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918631b-72a2-4a33-834f-9961580da61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.652036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918631b-72a2-4a33-834f-9961580da61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.652278 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683088bb-80af-4ede-bc87-392f0e46963a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.654875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918631b-72a2-4a33-834f-9961580da61d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.667862 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 640/1271] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.669130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683088bb-80af-4ede-bc87-392f0e46963a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.681741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 632/1272] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.681741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918631b-72a2-4a33-834f-9961580da61d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.688280 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683088bb-80af-4ede-bc87-392f0e46963a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.690828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:47.699515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918631b-72a2-4a33-834f-9961580da61d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.701567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66bcfb-5319-45d8-8dcd-ccd27ca16ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.702160 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66bcfb-5319-45d8-8dcd-ccd27ca16ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.702437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66bcfb-5319-45d8-8dcd-ccd27ca16ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.702728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66bcfb-5319-45d8-8dcd-ccd27ca16ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.703363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66bcfb-5319-45d8-8dcd-ccd27ca16ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.705040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66bcfb-5319-45d8-8dcd-ccd27ca16ec5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.715196 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67f7f6-c0b8-4ac2-82a2-6306e42c7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.715859 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67f7f6-c0b8-4ac2-82a2-6306e42c7fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.716629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67f7f6-c0b8-4ac2-82a2-6306e42c7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.716629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67f7f6-c0b8-4ac2-82a2-6306e42c7fa2 admin admin] PATH_INFO: `/v3/projects/d02613e648814da8a1bda99cd56cc720/users/eb19406216904864b983404a0ce65e1f/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.727567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 641/1273] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.731148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66bcfb-5319-45d8-8dcd-ccd27ca16ec5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.745280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67f7f6-c0b8-4ac2-82a2-6306e42c7fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02613e648814da8a1bda99cd56cc720, user_id=eb19406216904864b983404a0ce65e1f, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.747903 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67f7f6-c0b8-4ac2-82a2-6306e42c7fa2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.752206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66bcfb-5319-45d8-8dcd-ccd27ca16ec5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.760575 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143fae-557f-4350-b6de-a2b40e015c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.761527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143fae-557f-4350-b6de-a2b40e015c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.761647 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143fae-557f-4350-b6de-a2b40e015c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.761839 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f143fae-557f-4350-b6de-a2b40e015c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.762541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f143fae-557f-4350-b6de-a2b40e015c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.764485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f143fae-557f-4350-b6de-a2b40e015c75 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.779686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 642/1274] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.779686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143fae-557f-4350-b6de-a2b40e015c75 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.781837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 633/1275] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:47 2022] PUT /identity/v3/projects/d02613e648814da8a1bda99cd56cc720/users/eb19406216904864b983404a0ce65e1f/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:47.783375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67f7f6-c0b8-4ac2-82a2-6306e42c7fa2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.791149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f143fae-557f-4350-b6de-a2b40e015c75 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.892779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ded69-6751-40c7-941d-03767cd48ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.893537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ded69-6751-40c7-941d-03767cd48ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.893816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ded69-6751-40c7-941d-03767cd48ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.894081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ded69-6751-40c7-941d-03767cd48ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.894864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ded69-6751-40c7-941d-03767cd48ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.896571 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ded69-6751-40c7-941d-03767cd48ebd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.917644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 643/1276] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.918475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ded69-6751-40c7-941d-03767cd48ebd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.931545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67f7f6-c0b8-4ac2-82a2-6306e42c7fa2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.942490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08911385-8347-441e-9bcc-3cf0996916cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.942902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911385-8347-441e-9bcc-3cf0996916cb admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.943328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911385-8347-441e-9bcc-3cf0996916cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.943550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911385-8347-441e-9bcc-3cf0996916cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.944215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08911385-8347-441e-9bcc-3cf0996916cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.945916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08911385-8347-441e-9bcc-3cf0996916cb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.947511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ded69-6751-40c7-941d-03767cd48ebd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:47.958478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a645fb3-ff01-4d99-bd66-cb0767f3477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:47.959197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645fb3-ff01-4d99-bd66-cb0767f3477d admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:47.959316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645fb3-ff01-4d99-bd66-cb0767f3477d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:47.959602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645fb3-ff01-4d99-bd66-cb0767f3477d admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:47.961385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a645fb3-ff01-4d99-bd66-cb0767f3477d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:47.963931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a645fb3-ff01-4d99-bd66-cb0767f3477d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:47.975397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:47.976465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 634/1277] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.978573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08911385-8347-441e-9bcc-3cf0996916cb admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.985799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 644/1278] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:47.986740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a645fb3-ff01-4d99-bd66-cb0767f3477d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:47.996364 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08911385-8347-441e-9bcc-3cf0996916cb admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:48.002632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6f855-9b63-40bc-8820-3619abefdde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:48.003293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6f855-9b63-40bc-8820-3619abefdde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.003570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6f855-9b63-40bc-8820-3619abefdde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.003834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6f855-9b63-40bc-8820-3619abefdde6 admin admin] PATH_INFO: `/v3/projects/0aef2e70cfd74dd58255b377b7994c31/users/4f181f7f91654858be10b1df11cbfaab/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.007902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a645fb3-ff01-4d99-bd66-cb0767f3477d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:48.015227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabda5e-8ef9-4b85-a4af-3032e8901c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:48.016787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabda5e-8ef9-4b85-a4af-3032e8901c74 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.017401 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabda5e-8ef9-4b85-a4af-3032e8901c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.018112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabda5e-8ef9-4b85-a4af-3032e8901c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.020271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabda5e-8ef9-4b85-a4af-3032e8901c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:48.022801 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6f855-9b63-40bc-8820-3619abefdde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aef2e70cfd74dd58255b377b7994c31, user_id=4f181f7f91654858be10b1df11cbfaab, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:48.024073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabda5e-8ef9-4b85-a4af-3032e8901c74 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:48.025890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6f855-9b63-40bc-8820-3619abefdde6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:48.042900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 635/1279] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:47 2022] PUT /identity/v3/projects/0aef2e70cfd74dd58255b377b7994c31/users/4f181f7f91654858be10b1df11cbfaab/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:48.044226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70193d8-aae5-4b8b-a563-dc4236d35d53 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.044507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70193d8-aae5-4b8b-a563-dc4236d35d53 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.044771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70193d8-aae5-4b8b-a563-dc4236d35d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.049772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 645/1280] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:48.050673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabda5e-8ef9-4b85-a4af-3032e8901c74 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:48.073151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabda5e-8ef9-4b85-a4af-3032e8901c74 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:48.077681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c70193d8-aae5-4b8b-a563-dc4236d35d53 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:48.083078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c70193d8-aae5-4b8b-a563-dc4236d35d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:48.175744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e148e-6e8e-4833-a186-c7cf262349ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:48.178053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e148e-6e8e-4833-a186-c7cf262349ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.178439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e148e-6e8e-4833-a186-c7cf262349ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.180010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e148e-6e8e-4833-a186-c7cf262349ac admin admin] PATH_INFO: `/v3/projects/7f0dac5c781b4c6a8841b06f1931285c/users/02b8471c42ef4abc9b23901880216431/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.209486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 636/1281] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:48.209486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70193d8-aae5-4b8b-a563-dc4236d35d53 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:48.209783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e148e-6e8e-4833-a186-c7cf262349ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0dac5c781b4c6a8841b06f1931285c, user_id=02b8471c42ef4abc9b23901880216431, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:48.211469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e148e-6e8e-4833-a186-c7cf262349ac admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:48.220827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70193d8-aae5-4b8b-a563-dc4236d35d53 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:48.227831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d612fb8-58a7-4e79-beb2-cfc023706f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:48.228636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d612fb8-58a7-4e79-beb2-cfc023706f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.228922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d612fb8-58a7-4e79-beb2-cfc023706f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.229321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d612fb8-58a7-4e79-beb2-cfc023706f1c admin admin] PATH_INFO: `/v3/projects/1655c89ebf9140cbb88bb506f99b6eb0/users/855713a466914a84bd3697a308a8ed20/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.241107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 646/1282] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:48 2022] PUT /identity/v3/projects/7f0dac5c781b4c6a8841b06f1931285c/users/02b8471c42ef4abc9b23901880216431/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:48.251248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e148e-6e8e-4833-a186-c7cf262349ac admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:48.251398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d612fb8-58a7-4e79-beb2-cfc023706f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1655c89ebf9140cbb88bb506f99b6eb0, user_id=855713a466914a84bd3697a308a8ed20, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:48.253654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d612fb8-58a7-4e79-beb2-cfc023706f1c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:48.279112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 637/1283] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:48 2022] PUT /identity/v3/projects/1655c89ebf9140cbb88bb506f99b6eb0/users/855713a466914a84bd3697a308a8ed20/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:48.280584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d612fb8-58a7-4e79-beb2-cfc023706f1c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:48.323558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e148e-6e8e-4833-a186-c7cf262349ac admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:48.326346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:48.369525 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d612fb8-58a7-4e79-beb2-cfc023706f1c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:48.376967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e40a-afc3-4486-8a74-59b149dc7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:48.377757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e40a-afc3-4486-8a74-59b149dc7333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.378126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e40a-afc3-4486-8a74-59b149dc7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.378408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e40a-afc3-4486-8a74-59b149dc7333 admin admin] PATH_INFO: `/v3/projects/647ff1765a4547008f0906068818c949/users/4eba12ea4c4245099fea1e3be288c683/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.444433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418e40a-afc3-4486-8a74-59b149dc7333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647ff1765a4547008f0906068818c949, user_id=4eba12ea4c4245099fea1e3be288c683, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:48.444433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418e40a-afc3-4486-8a74-59b149dc7333 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:48.444433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 638/1284] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:48 2022] PUT /identity/v3/projects/647ff1765a4547008f0906068818c949/users/4eba12ea4c4245099fea1e3be288c683/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:48.446232 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04854de7-824b-4e4e-9b17-c2c8bdf43b61 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.446232 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04854de7-824b-4e4e-9b17-c2c8bdf43b61 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.446503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04854de7-824b-4e4e-9b17-c2c8bdf43b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.451497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cce2d-1751-47bd-a5c5-1c43226ad363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:48.452346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cce2d-1751-47bd-a5c5-1c43226ad363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.452718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cce2d-1751-47bd-a5c5-1c43226ad363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.459385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cce2d-1751-47bd-a5c5-1c43226ad363 admin admin] PATH_INFO: `/v3/projects/996137b80ce5435caac2396d4737b4b7/users/ba77f9bf4f1f481bb95621282d17b4ab/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.484964 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60cce2d-1751-47bd-a5c5-1c43226ad363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=996137b80ce5435caac2396d4737b4b7, user_id=ba77f9bf4f1f481bb95621282d17b4ab, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:48.488276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60cce2d-1751-47bd-a5c5-1c43226ad363 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:48.499207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-04854de7-824b-4e4e-9b17-c2c8bdf43b61 None None] MFA Rules not processed for user `4f181f7f91654858be10b1df11cbfaab`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:48.500628 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-04854de7-824b-4e4e-9b17-c2c8bdf43b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:48.522288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 647/1285] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:48 2022] PUT /identity/v3/projects/996137b80ce5435caac2396d4737b4b7/users/ba77f9bf4f1f481bb95621282d17b4ab/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:48.523523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c527c-c4eb-4f2b-bc50-5ddb02722d74 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.523882 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c527c-c4eb-4f2b-bc50-5ddb02722d74 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.524245 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c527c-c4eb-4f2b-bc50-5ddb02722d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.532771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:48.578668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ea0c527c-c4eb-4f2b-bc50-5ddb02722d74 None None] MFA Rules not processed for user `02b8471c42ef4abc9b23901880216431`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:48.579931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ea0c527c-c4eb-4f2b-bc50-5ddb02722d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:48.632723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 639/1286] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:48.634552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690034-b0b3-487b-b0e8-3a386a9eba34 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.635305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690034-b0b3-487b-b0e8-3a386a9eba34 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.635305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb690034-b0b3-487b-b0e8-3a386a9eba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.685835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cb690034-b0b3-487b-b0e8-3a386a9eba34 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:48.686780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cb690034-b0b3-487b-b0e8-3a386a9eba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:48.699638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 648/1287] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:48.706985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c527c-c4eb-4f2b-bc50-5ddb02722d74 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:48.790498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c527c-c4eb-4f2b-bc50-5ddb02722d74 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:48.795590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f33333-e805-4cf5-bf51-a06742b5ceb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:48.796216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f33333-e805-4cf5-bf51-a06742b5ceb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.797187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f33333-e805-4cf5-bf51-a06742b5ceb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.798456 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f33333-e805-4cf5-bf51-a06742b5ceb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.831382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 640/1288] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:48.833723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9236897-7431-4dfd-9e15-6a9659dc4486 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.834217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9236897-7431-4dfd-9e15-6a9659dc4486 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.834822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9236897-7431-4dfd-9e15-6a9659dc4486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.861295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a9236897-7431-4dfd-9e15-6a9659dc4486 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:48.863880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a9236897-7431-4dfd-9e15-6a9659dc4486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:48.875852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 641/1289] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:48.878380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ee10-53ab-47b7-8484-e6391231c441 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:48.879676 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ee10-53ab-47b7-8484-e6391231c441 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:48.880634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ee10-53ab-47b7-8484-e6391231c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:48.915978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f33333-e805-4cf5-bf51-a06742b5ceb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:48.918069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f33333-e805-4cf5-bf51-a06742b5ceb1 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:48.920366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a3f2ee10-53ab-47b7-8484-e6391231c441 None None] MFA Rules not processed for user `ba77f9bf4f1f481bb95621282d17b4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:48.921977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a3f2ee10-53ab-47b7-8484-e6391231c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:48.931070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 649/1290] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:48.932080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f33333-e805-4cf5-bf51-a06742b5ceb1 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:48.968890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:48.996001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:49.007667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f33333-e805-4cf5-bf51-a06742b5ceb1 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.022605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19b0a6-1fdf-4195-b040-8a76dfa1b85d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.023179 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b0a6-1fdf-4195-b040-8a76dfa1b85d service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.023539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b0a6-1fdf-4195-b040-8a76dfa1b85d service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.024059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b0a6-1fdf-4195-b040-8a76dfa1b85d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.044306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 642/1291] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:49.046047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6958abe-a639-4ca1-87d3-278864a94357 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.046335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6958abe-a639-4ca1-87d3-278864a94357 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.046604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6958abe-a639-4ca1-87d3-278864a94357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.098540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a6958abe-a639-4ca1-87d3-278864a94357 None None] MFA Rules not processed for user `7c0fbba3e7574f678bd6afb800382c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:49.100181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a6958abe-a639-4ca1-87d3-278864a94357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:49.134251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19b0a6-1fdf-4195-b040-8a76dfa1b85d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:49.135864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19b0a6-1fdf-4195-b040-8a76dfa1b85d service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:49.169117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 650/1292] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:49.170767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2897f-47df-4103-a871-1c01f5790be7 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.174901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2897f-47df-4103-a871-1c01f5790be7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.175224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2897f-47df-4103-a871-1c01f5790be7 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.183806 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 651/1293] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 07:26:49 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:49.184511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2897f-47df-4103-a871-1c01f5790be7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.219430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2897f-47df-4103-a871-1c01f5790be7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.228450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efc93d-15e0-4e9c-8a05-b01884afa0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.229234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efc93d-15e0-4e9c-8a05-b01884afa0bd service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.229607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efc93d-15e0-4e9c-8a05-b01884afa0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.229980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efc93d-15e0-4e9c-8a05-b01884afa0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.251791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efc93d-15e0-4e9c-8a05-b01884afa0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:49.253371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efc93d-15e0-4e9c-8a05-b01884afa0bd service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:49.255106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 643/1294] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:49.255990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6958abe-a639-4ca1-87d3-278864a94357 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.274979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6958abe-a639-4ca1-87d3-278864a94357 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.279887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab246a70-4776-41ee-a9df-3272a3d268d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.280570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab246a70-4776-41ee-a9df-3272a3d268d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.280923 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab246a70-4776-41ee-a9df-3272a3d268d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.281435 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab246a70-4776-41ee-a9df-3272a3d268d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.282584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 652/1295] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:49.289822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efc93d-15e0-4e9c-8a05-b01884afa0bd service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.292391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab246a70-4776-41ee-a9df-3272a3d268d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:49.296216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab246a70-4776-41ee-a9df-3272a3d268d6 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:49.309214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efc93d-15e0-4e9c-8a05-b01884afa0bd service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.321133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57424d2a-27c8-41df-ac53-df8179a8634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.321406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 644/1296] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:49.321747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424d2a-27c8-41df-ac53-df8179a8634f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.322011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424d2a-27c8-41df-ac53-df8179a8634f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.322279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424d2a-27c8-41df-ac53-df8179a8634f admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.322906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57424d2a-27c8-41df-ac53-df8179a8634f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:49.324065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885879-5937-4e1b-b437-456acc4871a5 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.324801 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57424d2a-27c8-41df-ac53-df8179a8634f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:49.326039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885879-5937-4e1b-b437-456acc4871a5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.326039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885879-5937-4e1b-b437-456acc4871a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.407698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 653/1297] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:49 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:49.412476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57424d2a-27c8-41df-ac53-df8179a8634f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.413588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-dd885879-5937-4e1b-b437-456acc4871a5 None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:49.420765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dd885879-5937-4e1b-b437-456acc4871a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:49.558710 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57424d2a-27c8-41df-ac53-df8179a8634f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.572978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d1b9a-a866-4797-ab97-388e1f7cc620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.573648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d1b9a-a866-4797-ab97-388e1f7cc620 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.573923 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d1b9a-a866-4797-ab97-388e1f7cc620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.574432 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d1b9a-a866-4797-ab97-388e1f7cc620 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.575070 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 645/1298] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 07:26:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:49.576063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885879-5937-4e1b-b437-456acc4871a5 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.583842 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d1b9a-a866-4797-ab97-388e1f7cc620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:49.585811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d1b9a-a866-4797-ab97-388e1f7cc620 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:49.605556 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885879-5937-4e1b-b437-456acc4871a5 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.611337 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807ed60-a07f-44d1-b8a6-b23cdf918353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.612074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807ed60-a07f-44d1-b8a6-b23cdf918353 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.612458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807ed60-a07f-44d1-b8a6-b23cdf918353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.614009 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807ed60-a07f-44d1-b8a6-b23cdf918353 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.614843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807ed60-a07f-44d1-b8a6-b23cdf918353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:49.619581 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807ed60-a07f-44d1-b8a6-b23cdf918353 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:49.643355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 654/1299] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:49 2022] POST /identity/v3/projects => generated 405 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:49.644422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d1b9a-a866-4797-ab97-388e1f7cc620 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.670214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 646/1300] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:49 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:49.670389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807ed60-a07f-44d1-b8a6-b23cdf918353 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.686388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:49.696938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807ed60-a07f-44d1-b8a6-b23cdf918353 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.772164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:49.820198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13276a-22ed-468d-bd22-b9327bdaa377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.821033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13276a-22ed-468d-bd22-b9327bdaa377 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.821483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13276a-22ed-468d-bd22-b9327bdaa377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.821880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13276a-22ed-468d-bd22-b9327bdaa377 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.822622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13276a-22ed-468d-bd22-b9327bdaa377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:49.824797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13276a-22ed-468d-bd22-b9327bdaa377 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:49.833275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d1b9a-a866-4797-ab97-388e1f7cc620 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.852581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e33e9-8633-4287-8924-69d867798193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.854790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e33e9-8633-4287-8924-69d867798193 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.855498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e33e9-8633-4287-8924-69d867798193 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.856595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e33e9-8633-4287-8924-69d867798193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.873700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 647/1301] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:49 2022] POST /identity/v3/users => generated 309 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:49.873700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13276a-22ed-468d-bd22-b9327bdaa377 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.895108 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13276a-22ed-468d-bd22-b9327bdaa377 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.914529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463afe5-ba19-407b-8b4c-31a9a2a4649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.915368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463afe5-ba19-407b-8b4c-31a9a2a4649a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.915771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463afe5-ba19-407b-8b4c-31a9a2a4649a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.916150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463afe5-ba19-407b-8b4c-31a9a2a4649a admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.918445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463afe5-ba19-407b-8b4c-31a9a2a4649a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:49.923602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463afe5-ba19-407b-8b4c-31a9a2a4649a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:49.952048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 648/1302] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:49.952545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463afe5-ba19-407b-8b4c-31a9a2a4649a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:49.974001 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463afe5-ba19-407b-8b4c-31a9a2a4649a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:49.987240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1abe60-0321-434f-aa40-0424d61d46c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:49.988121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1abe60-0321-434f-aa40-0424d61d46c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:49.989058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1abe60-0321-434f-aa40-0424d61d46c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:49.989538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1abe60-0321-434f-aa40-0424d61d46c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:49.990463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1abe60-0321-434f-aa40-0424d61d46c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:49.992326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1abe60-0321-434f-aa40-0424d61d46c5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:49.998947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e33e9-8633-4287-8924-69d867798193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:50.001097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e33e9-8633-4287-8924-69d867798193 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:50.021605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 649/1303] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:50.021605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1abe60-0321-434f-aa40-0424d61d46c5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:50.031949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 655/1304] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:50.032962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e33e9-8633-4287-8924-69d867798193 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:50.040536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1abe60-0321-434f-aa40-0424d61d46c5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:50.055737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9907dac-9398-4d87-b80c-6790eaa04bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:50.056588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907dac-9398-4d87-b80c-6790eaa04bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:50.056959 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907dac-9398-4d87-b80c-6790eaa04bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:50.057349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9907dac-9398-4d87-b80c-6790eaa04bce admin admin] PATH_INFO: `/v3/projects/37b48149f5bb40f6a01547e96ea04f56/users/71603ff5989743268100d52a3aac8213/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:50.060250 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e33e9-8633-4287-8924-69d867798193 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:50.079496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56815a2-adfe-4551-ad3d-da6e66ee575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:50.086857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56815a2-adfe-4551-ad3d-da6e66ee575b admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:50.087010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56815a2-adfe-4551-ad3d-da6e66ee575b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:50.087466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56815a2-adfe-4551-ad3d-da6e66ee575b admin admin] PATH_INFO: `/v3/projects/dd47bd89534b47179be0f67fac29965a/users/9a0b7104e3274d7e81673f566466821f/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:50.099038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9907dac-9398-4d87-b80c-6790eaa04bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b48149f5bb40f6a01547e96ea04f56, user_id=71603ff5989743268100d52a3aac8213, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:50.106635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9907dac-9398-4d87-b80c-6790eaa04bce admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:50.134595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56815a2-adfe-4551-ad3d-da6e66ee575b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd47bd89534b47179be0f67fac29965a, user_id=9a0b7104e3274d7e81673f566466821f, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:50.138494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56815a2-adfe-4551-ad3d-da6e66ee575b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:50.141237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 650/1305] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:50 2022] PUT /identity/v3/projects/37b48149f5bb40f6a01547e96ea04f56/users/71603ff5989743268100d52a3aac8213/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:50.145630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9907dac-9398-4d87-b80c-6790eaa04bce admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:50.173523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 656/1306] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:50 2022] PUT /identity/v3/projects/dd47bd89534b47179be0f67fac29965a/users/9a0b7104e3274d7e81673f566466821f/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:50.177098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56815a2-adfe-4551-ad3d-da6e66ee575b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:50.327033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9907dac-9398-4d87-b80c-6790eaa04bce admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:50.355472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56815a2-adfe-4551-ad3d-da6e66ee575b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:50.369503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f5bc2-efaf-4af0-b532-77f1d40993d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:50.370838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f5bc2-efaf-4af0-b532-77f1d40993d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:50.371506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f5bc2-efaf-4af0-b532-77f1d40993d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:50.372166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f5bc2-efaf-4af0-b532-77f1d40993d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:50.373487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f5bc2-efaf-4af0-b532-77f1d40993d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:50.376746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f5bc2-efaf-4af0-b532-77f1d40993d7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:50.408518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 657/1307] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:50.409673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f5bc2-efaf-4af0-b532-77f1d40993d7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:50.430726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f5bc2-efaf-4af0-b532-77f1d40993d7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:50.447306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d99db-8740-47bd-8bdb-aa5552cdddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:50.448586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d99db-8740-47bd-8bdb-aa5552cdddb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:50.448877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d99db-8740-47bd-8bdb-aa5552cdddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:50.449181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d99db-8740-47bd-8bdb-aa5552cdddb4 admin admin] PATH_INFO: `/v3/projects/dd47bd89534b47179be0f67fac29965a/users/9a0b7104e3274d7e81673f566466821f/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:50.454931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d99db-8740-47bd-8bdb-aa5552cdddb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd47bd89534b47179be0f67fac29965a, user_id=9a0b7104e3274d7e81673f566466821f, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:50.458174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d99db-8740-47bd-8bdb-aa5552cdddb4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:50.463063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:50.482820 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e5ab5-8796-4ae7-a056-fabee73cc211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:50.483616 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e5ab5-8796-4ae7-a056-fabee73cc211 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:50.484002 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e5ab5-8796-4ae7-a056-fabee73cc211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:50.484371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e5ab5-8796-4ae7-a056-fabee73cc211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:50.485636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e5ab5-8796-4ae7-a056-fabee73cc211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:50.488497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 658/1308] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:50 2022] PUT /identity/v3/projects/dd47bd89534b47179be0f67fac29965a/users/9a0b7104e3274d7e81673f566466821f/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:50.490974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e5ab5-8796-4ae7-a056-fabee73cc211 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:50.515574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 651/1309] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:50.517382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d99db-8740-47bd-8bdb-aa5552cdddb4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:50.652438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:50.694667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d99db-8740-47bd-8bdb-aa5552cdddb4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:50.709202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90a53a-8a87-4b80-9097-faa5ad07d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:50.709893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90a53a-8a87-4b80-9097-faa5ad07d6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:50.710170 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90a53a-8a87-4b80-9097-faa5ad07d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:50.710440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90a53a-8a87-4b80-9097-faa5ad07d6f2 admin admin] PATH_INFO: `/v3/projects/37b48149f5bb40f6a01547e96ea04f56/users/71603ff5989743268100d52a3aac8213/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:50.716370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90a53a-8a87-4b80-9097-faa5ad07d6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b48149f5bb40f6a01547e96ea04f56, user_id=71603ff5989743268100d52a3aac8213, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:50.719409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90a53a-8a87-4b80-9097-faa5ad07d6f2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:50.747579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 659/1310] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:50 2022] PUT /identity/v3/projects/37b48149f5bb40f6a01547e96ea04f56/users/71603ff5989743268100d52a3aac8213/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:50.757916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245974-7d3c-4138-a694-d6fa535a64d9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:50.758397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245974-7d3c-4138-a694-d6fa535a64d9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:50.758779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7245974-7d3c-4138-a694-d6fa535a64d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:50.844063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a7245974-7d3c-4138-a694-d6fa535a64d9 None None] MFA Rules not processed for user `71603ff5989743268100d52a3aac8213`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:50.847922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a7245974-7d3c-4138-a694-d6fa535a64d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:51.045132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 652/1311] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:51.060016 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90a53a-8a87-4b80-9097-faa5ad07d6f2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:51.066184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81abd5-6aa4-4f24-82f9-bda4c8b57cb2 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:51.067192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81abd5-6aa4-4f24-82f9-bda4c8b57cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:51.067527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81abd5-6aa4-4f24-82f9-bda4c8b57cb2 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:51.069794 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 653/1312] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 07:26:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:26:51.080189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3bbba-5e26-45ea-9b37-4c5b78748c6d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:51.080550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3bbba-5e26-45ea-9b37-4c5b78748c6d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:51.080739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3bbba-5e26-45ea-9b37-4c5b78748c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:51.120463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6af3bbba-5e26-45ea-9b37-4c5b78748c6d None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:51.123542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6af3bbba-5e26-45ea-9b37-4c5b78748c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:51.185657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90a53a-8a87-4b80-9097-faa5ad07d6f2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:51.199162 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc32e3c-9ede-4749-8226-247e8ed70586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:51.200148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc32e3c-9ede-4749-8226-247e8ed70586 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:51.200645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc32e3c-9ede-4749-8226-247e8ed70586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:51.201121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc32e3c-9ede-4749-8226-247e8ed70586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:51.233938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc32e3c-9ede-4749-8226-247e8ed70586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:51.235413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc32e3c-9ede-4749-8226-247e8ed70586 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:51.263486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 660/1313] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:51.337569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 654/1314] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:26:51.348990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbbc2-72a8-4580-987c-8bdbf4ac8f2a None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:51.349822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbbc2-72a8-4580-987c-8bdbf4ac8f2a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:51.350326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbbc2-72a8-4580-987c-8bdbf4ac8f2a None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:51.354199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 661/1315] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 2 07:26:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:51.366447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df8536-6fac-4390-bf6b-fc246d6c9f77 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:51.366888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df8536-6fac-4390-bf6b-fc246d6c9f77 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:51.367114 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df8536-6fac-4390-bf6b-fc246d6c9f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:51.430789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b9df8536-6fac-4390-bf6b-fc246d6c9f77 None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:51.431944 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b9df8536-6fac-4390-bf6b-fc246d6c9f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:51.452906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 655/1316] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:26:51.475370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cbbc2-72a8-4580-987c-8bdbf4ac8f2a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:51.494501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cbbc2-72a8-4580-987c-8bdbf4ac8f2a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:51.502067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d315f1-3e56-4f04-9d75-7e3d8893f992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:51.502722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d315f1-3e56-4f04-9d75-7e3d8893f992 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:51.502997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d315f1-3e56-4f04-9d75-7e3d8893f992 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:51.503265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d315f1-3e56-4f04-9d75-7e3d8893f992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:51.529592 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d315f1-3e56-4f04-9d75-7e3d8893f992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:51.531183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d315f1-3e56-4f04-9d75-7e3d8893f992 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:51.553843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 662/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:51.862011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819d867-0c19-4f87-ac3b-9a36c741ef5e None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:51.863002 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819d867-0c19-4f87-ac3b-9a36c741ef5e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:51.864065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819d867-0c19-4f87-ac3b-9a36c741ef5e None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:51.866287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 656/1318] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 2 07:26:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:51.875112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbc6f9-6d91-4647-b3fa-25ad98a835a0 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:51.875697 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbc6f9-6d91-4647-b3fa-25ad98a835a0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:51.876178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbc6f9-6d91-4647-b3fa-25ad98a835a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:51.943225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c9fbc6f9-6d91-4647-b3fa-25ad98a835a0 None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:51.946364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c9fbc6f9-6d91-4647-b3fa-25ad98a835a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:51.973438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 663/1319] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:26:52.002474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819d867-0c19-4f87-ac3b-9a36c741ef5e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:52.023242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819d867-0c19-4f87-ac3b-9a36c741ef5e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:52.031696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c782dd-2fa7-4c19-afda-f3262d99e847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:52.032570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c782dd-2fa7-4c19-afda-f3262d99e847 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:52.032997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c782dd-2fa7-4c19-afda-f3262d99e847 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:52.033445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c782dd-2fa7-4c19-afda-f3262d99e847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:52.065997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c782dd-2fa7-4c19-afda-f3262d99e847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:52.068111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c782dd-2fa7-4c19-afda-f3262d99e847 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:52.106753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 657/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:52.317999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbc6f9-6d91-4647-b3fa-25ad98a835a0 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:52.507800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbc6f9-6d91-4647-b3fa-25ad98a835a0 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:52.522059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:52.523815 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:52.524282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:52.526831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] PATH_INFO: `/v3/users/02b8471c42ef4abc9b23901880216431` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:52.530746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b8471c42ef4abc9b23901880216431)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:52.532868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:52.613832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c782dd-2fa7-4c19-afda-f3262d99e847 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:52.632816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c782dd-2fa7-4c19-afda-f3262d99e847 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:52.650822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:52.651480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:52.654875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:52.655158 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] PATH_INFO: `/v3/users/ba77f9bf4f1f481bb95621282d17b4ab` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:52.658136 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba77f9bf4f1f481bb95621282d17b4ab)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:52.663020 dv-cinder-804035-51-smb devstack@keystone.service[81558]: WARNING py.warnings [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:26:52.663020 dv-cinder-804035-51-smb devstack@keystone.service[81558]: warnings.warn(msg) Nov 02 07:26:52.663020 dv-cinder-804035-51-smb devstack@keystone.service[81558]: Nov 02 07:26:52.680968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:52.707517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b8471c42ef4abc9b23901880216431'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:52.708787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b8471c42ef4abc9b23901880216431'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:52.724506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b8471c42ef4abc9b23901880216431'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:52.726350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b8471c42ef4abc9b23901880216431'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:52.736158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:52.756449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ff939804-1e33-4f9f-96f3-388ffe626ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b8471c42ef4abc9b23901880216431'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:52.801783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 664/1321] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:26:52 2022] DELETE /identity/v3/users/02b8471c42ef4abc9b23901880216431 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:52.803275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4798ead-b508-4b32-a564-7661b5b1b54a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:52.803562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4798ead-b508-4b32-a564-7661b5b1b54a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:52.805920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4798ead-b508-4b32-a564-7661b5b1b54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:52.838818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c4798ead-b508-4b32-a564-7661b5b1b54a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:52.840378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c4798ead-b508-4b32-a564-7661b5b1b54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:52.961256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:52.967324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 665/1322] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:52.980622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba77f9bf4f1f481bb95621282d17b4ab'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:52.997810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba77f9bf4f1f481bb95621282d17b4ab'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:52.999034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba77f9bf4f1f481bb95621282d17b4ab'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:53.058651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba77f9bf4f1f481bb95621282d17b4ab'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:53.074187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4798ead-b508-4b32-a564-7661b5b1b54a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:53.076170 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c4798ead-b508-4b32-a564-7661b5b1b54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:53.088417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5a0e8097-7e57-48a7-bda3-421132d659df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba77f9bf4f1f481bb95621282d17b4ab'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:53.099338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 658/1323] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:26:52 2022] DELETE /identity/v3/users/ba77f9bf4f1f481bb95621282d17b4ab => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:26:53.110728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5994d8f-85e6-4b68-b102-c6ef54f5646d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:53.111408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5994d8f-85e6-4b68-b102-c6ef54f5646d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:53.112016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5994d8f-85e6-4b68-b102-c6ef54f5646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:53.140002 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e5994d8f-85e6-4b68-b102-c6ef54f5646d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:53.141729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e5994d8f-85e6-4b68-b102-c6ef54f5646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:53.241850 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4798ead-b508-4b32-a564-7661b5b1b54a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:53.292402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 659/1324] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:53.383868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc1f26-0b9b-48a9-8531-eeda2e916c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:53.384878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1f26-0b9b-48a9-8531-eeda2e916c95 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:53.385565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1f26-0b9b-48a9-8531-eeda2e916c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:53.386006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc1f26-0b9b-48a9-8531-eeda2e916c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:53.389305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-befc1f26-0b9b-48a9-8531-eeda2e916c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:53.404281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc1f26-0b9b-48a9-8531-eeda2e916c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:53.406327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc1f26-0b9b-48a9-8531-eeda2e916c95 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:53.423534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 666/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:53.436877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5994d8f-85e6-4b68-b102-c6ef54f5646d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:53.438430 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e5994d8f-85e6-4b68-b102-c6ef54f5646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:53.458023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5994d8f-85e6-4b68-b102-c6ef54f5646d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:53.473566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a122ede-f2ed-40f6-9246-8d86c02aa043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:53.474113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a122ede-f2ed-40f6-9246-8d86c02aa043 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:53.474435 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a122ede-f2ed-40f6-9246-8d86c02aa043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:53.474754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a122ede-f2ed-40f6-9246-8d86c02aa043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:53.502482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a122ede-f2ed-40f6-9246-8d86c02aa043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:53.506856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a122ede-f2ed-40f6-9246-8d86c02aa043 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:53.533926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 660/1326] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:53.656917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed5427-f278-4ca1-b86f-0298ce3edbb7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:53.657581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed5427-f278-4ca1-b86f-0298ce3edbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:53.657581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed5427-f278-4ca1-b86f-0298ce3edbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:53.717610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c6ed5427-f278-4ca1-b86f-0298ce3edbb7 None None] MFA Rules not processed for user `9a0b7104e3274d7e81673f566466821f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:53.718927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c6ed5427-f278-4ca1-b86f-0298ce3edbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:53.775328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:53.875029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 667/1327] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:54.624567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a122ede-f2ed-40f6-9246-8d86c02aa043 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:54.627237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9a122ede-f2ed-40f6-9246-8d86c02aa043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:54.657764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a122ede-f2ed-40f6-9246-8d86c02aa043 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:54.666033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:54.667898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:54.668387 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:54.668871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] PATH_INFO: `/v3/projects/996137b80ce5435caac2396d4737b4b7` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:54.672838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] RBAC: Authorizing `identity:delete_project(project_id=996137b80ce5435caac2396d4737b4b7)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:54.676662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:54.790910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '996137b80ce5435caac2396d4737b4b7', 'request_id': 'req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:54.815219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '996137b80ce5435caac2396d4737b4b7', 'request_id': 'req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:54.834759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '996137b80ce5435caac2396d4737b4b7', 'request_id': 'req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:54.854161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] The token cache is being invalidate because project 996137b80ce5435caac2396d4737b4b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:26:54.854161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:54.854926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:54.861836 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 661/1328] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:26:54 2022] DELETE /identity/v3/projects/996137b80ce5435caac2396d4737b4b7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:54.864550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed5427-f278-4ca1-b86f-0298ce3edbb7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:54.877834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed5427-f278-4ca1-b86f-0298ce3edbb7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:54.974586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:54.976342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:55.093786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:55.096658 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:55.098759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:55.099197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] PATH_INFO: `/v3/users/71603ff5989743268100d52a3aac8213` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:55.105334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71603ff5989743268100d52a3aac8213)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:55.109841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:55.124719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:55.284266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7a2c4-ac3b-420c-94aa-69ed5536aacc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:55.309852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:55.311062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:55.312722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71603ff5989743268100d52a3aac8213'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:55.312947 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:55.313999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] PATH_INFO: `/v3/projects/7f0dac5c781b4c6a8841b06f1931285c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:55.315170 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71603ff5989743268100d52a3aac8213'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:55.316931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0dac5c781b4c6a8841b06f1931285c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:55.321037 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:55.335082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71603ff5989743268100d52a3aac8213'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:55.335862 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71603ff5989743268100d52a3aac8213'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:55.371282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee942039-be30-4376-be77-fbb85138fc25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71603ff5989743268100d52a3aac8213'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:55.412838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 668/1329] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:26:54 2022] DELETE /identity/v3/users/71603ff5989743268100d52a3aac8213 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:55.453250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0dac5c781b4c6a8841b06f1931285c', 'request_id': 'req-1d0f5344-46c1-49b8-8ab0-acd2424f2835'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:55.470618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0dac5c781b4c6a8841b06f1931285c', 'request_id': 'req-1d0f5344-46c1-49b8-8ab0-acd2424f2835'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:55.480961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0dac5c781b4c6a8841b06f1931285c', 'request_id': 'req-1d0f5344-46c1-49b8-8ab0-acd2424f2835'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:55.515718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] The token cache is being invalidate because project 7f0dac5c781b4c6a8841b06f1931285c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:26:55.516150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:55.516789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1d0f5344-46c1-49b8-8ab0-acd2424f2835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:55.518518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 662/1330] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:26:54 2022] DELETE /identity/v3/projects/7f0dac5c781b4c6a8841b06f1931285c => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:26:55.523738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99422f-8e6f-45a9-99fa-c971996c2b48 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:55.524092 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99422f-8e6f-45a9-99fa-c971996c2b48 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:55.524571 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99422f-8e6f-45a9-99fa-c971996c2b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:55.577706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-dd99422f-8e6f-45a9-99fa-c971996c2b48 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:55.579279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dd99422f-8e6f-45a9-99fa-c971996c2b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:55.750193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:55.809940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 669/1331] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:55.818083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c0ea-2962-4d9c-b567-475210bdd1fc None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:55.818627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c0ea-2962-4d9c-b567-475210bdd1fc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:55.818627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c0ea-2962-4d9c-b567-475210bdd1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:55.852720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c599c0ea-2962-4d9c-b567-475210bdd1fc None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:55.854009 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c599c0ea-2962-4d9c-b567-475210bdd1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:55.864526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 663/1332] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:55.868795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99422f-8e6f-45a9-99fa-c971996c2b48 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:55.879910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99422f-8e6f-45a9-99fa-c971996c2b48 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:55.888369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d7181-eeac-4768-b511-c0a001129696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:55.889507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d7181-eeac-4768-b511-c0a001129696 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:55.890105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d7181-eeac-4768-b511-c0a001129696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:55.890724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d7181-eeac-4768-b511-c0a001129696 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:55.892622 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d7181-eeac-4768-b511-c0a001129696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:55.893197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d7181-eeac-4768-b511-c0a001129696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:55.895627 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d7181-eeac-4768-b511-c0a001129696 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:55.921173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 670/1333] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:55.934666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599c0ea-2962-4d9c-b567-475210bdd1fc None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:55.952294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599c0ea-2962-4d9c-b567-475210bdd1fc None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:55.962782 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0df44a-f13a-491a-a1c8-c4d70c28824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:55.964321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df44a-f13a-491a-a1c8-c4d70c28824e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:55.964870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df44a-f13a-491a-a1c8-c4d70c28824e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:55.965377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df44a-f13a-491a-a1c8-c4d70c28824e admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:55.966273 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0df44a-f13a-491a-a1c8-c4d70c28824e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:55.968432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0df44a-f13a-491a-a1c8-c4d70c28824e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:56.069086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 664/1334] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:55 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:56.073311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d7181-eeac-4768-b511-c0a001129696 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:56.093177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d7181-eeac-4768-b511-c0a001129696 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:56.220955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721d58-d976-46c1-b7b3-9ab5374fc749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:56.222929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721d58-d976-46c1-b7b3-9ab5374fc749 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:56.225426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721d58-d976-46c1-b7b3-9ab5374fc749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:56.226328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721d58-d976-46c1-b7b3-9ab5374fc749 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:56.228042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85721d58-d976-46c1-b7b3-9ab5374fc749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:56.237142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85721d58-d976-46c1-b7b3-9ab5374fc749 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:56.273919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 671/1335] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:56 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:56.277821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0df44a-f13a-491a-a1c8-c4d70c28824e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:56.297929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0df44a-f13a-491a-a1c8-c4d70c28824e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:56.306228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8e3db-c5c9-4099-bd4d-39f51707076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:56.308339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8e3db-c5c9-4099-bd4d-39f51707076a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:56.308739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8e3db-c5c9-4099-bd4d-39f51707076a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:56.309825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8e3db-c5c9-4099-bd4d-39f51707076a admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:56.310743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8e3db-c5c9-4099-bd4d-39f51707076a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:56.313042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8e3db-c5c9-4099-bd4d-39f51707076a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:56.335353 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 665/1336] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:56.337787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721d58-d976-46c1-b7b3-9ab5374fc749 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:56.362072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721d58-d976-46c1-b7b3-9ab5374fc749 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:56.373435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b923b8e-9051-4326-af57-92421aa6a0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:56.374705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923b8e-9051-4326-af57-92421aa6a0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:56.377853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923b8e-9051-4326-af57-92421aa6a0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:56.378770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923b8e-9051-4326-af57-92421aa6a0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:56.379071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b923b8e-9051-4326-af57-92421aa6a0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:56.381642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b923b8e-9051-4326-af57-92421aa6a0f3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:56.396067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 672/1337] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:56.399578 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8e3db-c5c9-4099-bd4d-39f51707076a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:56.431097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8e3db-c5c9-4099-bd4d-39f51707076a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:56.458375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028749ac-14cd-4a92-a880-21b8200b35fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:56.461085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028749ac-14cd-4a92-a880-21b8200b35fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:56.461373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028749ac-14cd-4a92-a880-21b8200b35fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:56.461649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028749ac-14cd-4a92-a880-21b8200b35fc admin admin] PATH_INFO: `/v3/projects/c1259df5f776461290cad8d320566d84/users/eae621ede1fc4737873b376efbcb1755/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:56.485199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028749ac-14cd-4a92-a880-21b8200b35fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1259df5f776461290cad8d320566d84, user_id=eae621ede1fc4737873b376efbcb1755, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:56.493125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028749ac-14cd-4a92-a880-21b8200b35fc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:56.539873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 666/1338] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:56 2022] PUT /identity/v3/projects/c1259df5f776461290cad8d320566d84/users/eae621ede1fc4737873b376efbcb1755/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:56.552221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafff40-d241-4810-89e3-c9276a6838ed None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:56.552501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafff40-d241-4810-89e3-c9276a6838ed None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:56.552793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafff40-d241-4810-89e3-c9276a6838ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:56.597920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e75d1a-c6d7-41df-8fd2-6b2e8174ff2b None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:56.598380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e75d1a-c6d7-41df-8fd2-6b2e8174ff2b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:56.598948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e75d1a-c6d7-41df-8fd2-6b2e8174ff2b None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:56.600965 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 667/1339] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:26:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:26:56.616748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7be598-4333-4fc4-9db4-c22c67673b4e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:56.617049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3eafff40-d241-4810-89e3-c9276a6838ed None None] MFA Rules not processed for user `eae621ede1fc4737873b376efbcb1755`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:56.617306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7be598-4333-4fc4-9db4-c22c67673b4e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:56.617763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7be598-4333-4fc4-9db4-c22c67673b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:56.618398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3eafff40-d241-4810-89e3-c9276a6838ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:56.658493 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8b7be598-4333-4fc4-9db4-c22c67673b4e None None] MFA Rules not processed for user `55214b594a3f42ff8a7e0cecdef98937`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:56.659822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8b7be598-4333-4fc4-9db4-c22c67673b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:56.774577 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:56.814531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 673/1340] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:56.820196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafff40-d241-4810-89e3-c9276a6838ed None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:56.823795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 668/1341] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:26:56.877431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7be598-4333-4fc4-9db4-c22c67673b4e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:56.879831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8b7be598-4333-4fc4-9db4-c22c67673b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:56.914395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:56.924556 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7be598-4333-4fc4-9db4-c22c67673b4e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:56.937704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3ec37-72d3-4210-870b-8ec1fc781cc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:56.938338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3ec37-72d3-4210-870b-8ec1fc781cc9 service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:56.938619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3ec37-72d3-4210-870b-8ec1fc781cc9 service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:56.938894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3ec37-72d3-4210-870b-8ec1fc781cc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:56.952055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3ec37-72d3-4210-870b-8ec1fc781cc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:56.954664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3ec37-72d3-4210-870b-8ec1fc781cc9 service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:56.972169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 669/1342] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:26:56.985194 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafff40-d241-4810-89e3-c9276a6838ed None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:56.997459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd22f9-4465-45e0-a5d8-732a04752031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:56.998092 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd22f9-4465-45e0-a5d8-732a04752031 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:56.998370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd22f9-4465-45e0-a5d8-732a04752031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:56.998641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd22f9-4465-45e0-a5d8-732a04752031 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:56.999282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd22f9-4465-45e0-a5d8-732a04752031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:57.001256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd22f9-4465-45e0-a5d8-732a04752031 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:57.061916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 674/1343] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:56 2022] POST /identity/v3/projects => generated 373 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:57.067229 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3ec37-72d3-4210-870b-8ec1fc781cc9 service placement] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:57.099611 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3ec37-72d3-4210-870b-8ec1fc781cc9 service placement] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:57.343057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37263469-0814-4be6-b35d-1b4af30c9591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:57.343868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37263469-0814-4be6-b35d-1b4af30c9591 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:57.343981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37263469-0814-4be6-b35d-1b4af30c9591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:57.344221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37263469-0814-4be6-b35d-1b4af30c9591 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:57.344875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37263469-0814-4be6-b35d-1b4af30c9591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:57.347911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37263469-0814-4be6-b35d-1b4af30c9591 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:57.406890 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd22f9-4465-45e0-a5d8-732a04752031 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:57.407742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 670/1344] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:57 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:57.427013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd22f9-4465-45e0-a5d8-732a04752031 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:57.443207 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3f02-d9ab-4148-9062-ff6b93bee1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:57.443818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3f02-d9ab-4148-9062-ff6b93bee1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:57.444210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3f02-d9ab-4148-9062-ff6b93bee1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:57.444378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3f02-d9ab-4148-9062-ff6b93bee1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:57.444990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc3f02-d9ab-4148-9062-ff6b93bee1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:57.452814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc3f02-d9ab-4148-9062-ff6b93bee1d8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:57.493510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 675/1345] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:26:57.496234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37263469-0814-4be6-b35d-1b4af30c9591 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:57.518528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37263469-0814-4be6-b35d-1b4af30c9591 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:57.535822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5bb3a-ec52-4fb1-88f9-9fe28560809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:57.537038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5bb3a-ec52-4fb1-88f9-9fe28560809b admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:57.537387 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5bb3a-ec52-4fb1-88f9-9fe28560809b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:57.537890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5bb3a-ec52-4fb1-88f9-9fe28560809b admin admin] PATH_INFO: `/v3/projects/84afbf3c5f1b468ba79d21a31394028d/users/2a97b1f68c9c4b73b176a0ebf7a8080a/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:57.596792 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5bb3a-ec52-4fb1-88f9-9fe28560809b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84afbf3c5f1b468ba79d21a31394028d, user_id=2a97b1f68c9c4b73b176a0ebf7a8080a, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:57.605053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5bb3a-ec52-4fb1-88f9-9fe28560809b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:57.639774 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 671/1346] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:57 2022] PUT /identity/v3/projects/84afbf3c5f1b468ba79d21a31394028d/users/2a97b1f68c9c4b73b176a0ebf7a8080a/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:57.641517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3f02-d9ab-4148-9062-ff6b93bee1d8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:57.659346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3f02-d9ab-4148-9062-ff6b93bee1d8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:57.821449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d72d6-98cf-4e71-8de0-4aa38da8e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:57.822078 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d72d6-98cf-4e71-8de0-4aa38da8e6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:57.822350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d72d6-98cf-4e71-8de0-4aa38da8e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:57.822616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d72d6-98cf-4e71-8de0-4aa38da8e6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:57.823261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d72d6-98cf-4e71-8de0-4aa38da8e6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:57.824879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d72d6-98cf-4e71-8de0-4aa38da8e6c8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:57.841317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 676/1347] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:57.841501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5bb3a-ec52-4fb1-88f9-9fe28560809b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:57.854793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5bb3a-ec52-4fb1-88f9-9fe28560809b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:57.883468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f36657-bfef-49be-a745-ddabd35950ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:57.884153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f36657-bfef-49be-a745-ddabd35950ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:57.884458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f36657-bfef-49be-a745-ddabd35950ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:57.884731 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f36657-bfef-49be-a745-ddabd35950ee admin admin] PATH_INFO: `/v3/projects/84afbf3c5f1b468ba79d21a31394028d/users/2a97b1f68c9c4b73b176a0ebf7a8080a/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:57.886846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f36657-bfef-49be-a745-ddabd35950ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=84afbf3c5f1b468ba79d21a31394028d, user_id=2a97b1f68c9c4b73b176a0ebf7a8080a, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:57.889569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f36657-bfef-49be-a745-ddabd35950ee admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:57.919825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 672/1348] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:57 2022] PUT /identity/v3/projects/84afbf3c5f1b468ba79d21a31394028d/users/2a97b1f68c9c4b73b176a0ebf7a8080a/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:26:57.934968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439107b-f623-4ad4-9c68-a81b7c175521 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:57.935413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439107b-f623-4ad4-9c68-a81b7c175521 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:57.935505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439107b-f623-4ad4-9c68-a81b7c175521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:58.001181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2439107b-f623-4ad4-9c68-a81b7c175521 None None] MFA Rules not processed for user `2a97b1f68c9c4b73b176a0ebf7a8080a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:58.002784 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2439107b-f623-4ad4-9c68-a81b7c175521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:58.109563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 677/1349] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:58.121783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f36657-bfef-49be-a745-ddabd35950ee admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:58.123963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a5f36657-bfef-49be-a745-ddabd35950ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:58.314111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f36657-bfef-49be-a745-ddabd35950ee admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:58.325394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4c00-4bd7-400d-96ef-0839c22474b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:58.326228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4c00-4bd7-400d-96ef-0839c22474b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:58.326613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4c00-4bd7-400d-96ef-0839c22474b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:58.327015 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4c00-4bd7-400d-96ef-0839c22474b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:58.340264 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d4c00-4bd7-400d-96ef-0839c22474b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:58.342407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d4c00-4bd7-400d-96ef-0839c22474b2 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:58.357197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 673/1350] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:26:58.458091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439107b-f623-4ad4-9c68-a81b7c175521 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:58.459602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2439107b-f623-4ad4-9c68-a81b7c175521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:58.493760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4c00-4bd7-400d-96ef-0839c22474b2 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:58.505590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4c00-4bd7-400d-96ef-0839c22474b2 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:58.509926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbfd87-b438-4de6-b0a8-aeb12ea85ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:58.510995 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbfd87-b438-4de6-b0a8-aeb12ea85ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:58.511420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbfd87-b438-4de6-b0a8-aeb12ea85ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:58.512819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbfd87-b438-4de6-b0a8-aeb12ea85ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:58.540138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:58.600408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439107b-f623-4ad4-9c68-a81b7c175521 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:58.603471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:58.610153 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:58.612704 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:58.613046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:58.617225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] PATH_INFO: `/v3/projects/37b48149f5bb40f6a01547e96ea04f56` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:58.619016 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37b48149f5bb40f6a01547e96ea04f56)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:58.620227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: WARNING py.warnings [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:26:58.620227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: warnings.warn(msg) Nov 02 07:26:58.620227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: Nov 02 07:26:58.622475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:58.657131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbfd87-b438-4de6-b0a8-aeb12ea85ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:58.658758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbfd87-b438-4de6-b0a8-aeb12ea85ac3 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:58.683051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 674/1351] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:26:58.684507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c10b-cd0c-4f27-bfb2-487789287293 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:58.687292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c10b-cd0c-4f27-bfb2-487789287293 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:58.687685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c10b-cd0c-4f27-bfb2-487789287293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:58.751201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b48149f5bb40f6a01547e96ea04f56', 'request_id': 'req-63feb6cc-b99e-4e81-8539-6079621ad630'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:58.764942 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b48149f5bb40f6a01547e96ea04f56', 'request_id': 'req-63feb6cc-b99e-4e81-8539-6079621ad630'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:58.771815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ec67c10b-cd0c-4f27-bfb2-487789287293 None None] MFA Rules not processed for user `78bec0414d064ed8901271fc4c57cfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:58.773297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ec67c10b-cd0c-4f27-bfb2-487789287293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:58.790211 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b48149f5bb40f6a01547e96ea04f56', 'request_id': 'req-63feb6cc-b99e-4e81-8539-6079621ad630'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:58.811060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] The token cache is being invalidate because project 37b48149f5bb40f6a01547e96ea04f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:26:58.811623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:58.812443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-63feb6cc-b99e-4e81-8539-6079621ad630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:26:58.819269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 678/1352] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:26:58 2022] DELETE /identity/v3/projects/37b48149f5bb40f6a01547e96ea04f56 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:26:58.821048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0e7a8-8620-4bdd-9727-6f6c3056ddd7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:58.821455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0e7a8-8620-4bdd-9727-6f6c3056ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:58.821928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0e7a8-8620-4bdd-9727-6f6c3056ddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:58.869052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1ff0e7a8-8620-4bdd-9727-6f6c3056ddd7 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:58.870470 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1ff0e7a8-8620-4bdd-9727-6f6c3056ddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:58.938049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 675/1353] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:58.953449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c10b-cd0c-4f27-bfb2-487789287293 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:58.955038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ec67c10b-cd0c-4f27-bfb2-487789287293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:59.037142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 679/1354] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:59.046304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e32689-4e36-4fd5-8e64-dd4920605dea None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:59.047066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e32689-4e36-4fd5-8e64-dd4920605dea None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:59.047419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e32689-4e36-4fd5-8e64-dd4920605dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:59.081411 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-19e32689-4e36-4fd5-8e64-dd4920605dea None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:59.083198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-19e32689-4e36-4fd5-8e64-dd4920605dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:59.096909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 680/1355] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:59.102820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e32689-4e36-4fd5-8e64-dd4920605dea None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:59.116038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e32689-4e36-4fd5-8e64-dd4920605dea None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:59.126077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c82f4-7164-44af-b4ee-6a08e206415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:59.126918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c82f4-7164-44af-b4ee-6a08e206415b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:59.135431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c82f4-7164-44af-b4ee-6a08e206415b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:59.135995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c82f4-7164-44af-b4ee-6a08e206415b admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:59.137685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c82f4-7164-44af-b4ee-6a08e206415b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:59.138417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c82f4-7164-44af-b4ee-6a08e206415b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:59.141376 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c82f4-7164-44af-b4ee-6a08e206415b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:59.159590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c10b-cd0c-4f27-bfb2-487789287293 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:59.174178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 681/1356] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:26:59.179370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c82f4-7164-44af-b4ee-6a08e206415b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:59.198619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a38aef-a42c-4f8c-8a91-7a7c6a61c292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:59.199259 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a38aef-a42c-4f8c-8a91-7a7c6a61c292 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:59.199537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a38aef-a42c-4f8c-8a91-7a7c6a61c292 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:59.199805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a38aef-a42c-4f8c-8a91-7a7c6a61c292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:59.201811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c82f4-7164-44af-b4ee-6a08e206415b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:59.211174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea2399-9967-45df-b7d2-56f8d0da8b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:59.211740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea2399-9967-45df-b7d2-56f8d0da8b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:59.212095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea2399-9967-45df-b7d2-56f8d0da8b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:59.212583 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea2399-9967-45df-b7d2-56f8d0da8b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:59.213518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea2399-9967-45df-b7d2-56f8d0da8b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:59.216506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea2399-9967-45df-b7d2-56f8d0da8b39 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:59.229065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a38aef-a42c-4f8c-8a91-7a7c6a61c292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:59.230690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a38aef-a42c-4f8c-8a91-7a7c6a61c292 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:59.261420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 676/1357] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:26:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:26:59.283650 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a38aef-a42c-4f8c-8a91-7a7c6a61c292 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:59.283967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 682/1358] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:59 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:59.302786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a38aef-a42c-4f8c-8a91-7a7c6a61c292 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:59.399673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:59.436287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e2b92-766f-47fe-97d3-335d5223663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:59.436694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e2b92-766f-47fe-97d3-335d5223663a admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:59.437034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e2b92-766f-47fe-97d3-335d5223663a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:59.437323 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e2b92-766f-47fe-97d3-335d5223663a admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:59.437904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e2b92-766f-47fe-97d3-335d5223663a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:59.441069 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e2b92-766f-47fe-97d3-335d5223663a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:59.486296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 677/1359] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:59 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:26:59.491159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea2399-9967-45df-b7d2-56f8d0da8b39 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:59.507557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea2399-9967-45df-b7d2-56f8d0da8b39 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:59.516643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76f72-e72c-4845-880f-49e4c5d0ab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:59.518877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76f72-e72c-4845-880f-49e4c5d0ab7d admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:59.519862 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76f72-e72c-4845-880f-49e4c5d0ab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:59.522487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76f72-e72c-4845-880f-49e4c5d0ab7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:59.523261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f76f72-e72c-4845-880f-49e4c5d0ab7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:59.531366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f76f72-e72c-4845-880f-49e4c5d0ab7d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:59.555412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e2b92-766f-47fe-97d3-335d5223663a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:59.555657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 683/1360] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:59.567220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e2b92-766f-47fe-97d3-335d5223663a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:59.572346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5487a0-b920-40bd-a718-1bba296f2b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:59.572979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5487a0-b920-40bd-a718-1bba296f2b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:59.573286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5487a0-b920-40bd-a718-1bba296f2b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:59.573554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5487a0-b920-40bd-a718-1bba296f2b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:59.574507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5487a0-b920-40bd-a718-1bba296f2b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:59.576213 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5487a0-b920-40bd-a718-1bba296f2b7c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:59.588672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 678/1361] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:59.592578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76f72-e72c-4845-880f-49e4c5d0ab7d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:59.606254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76f72-e72c-4845-880f-49e4c5d0ab7d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:59.614071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4594a61-9dfc-4233-8f22-63e78ae976a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:59.614843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4594a61-9dfc-4233-8f22-63e78ae976a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:59.615177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4594a61-9dfc-4233-8f22-63e78ae976a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:59.615458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4594a61-9dfc-4233-8f22-63e78ae976a7 admin admin] PATH_INFO: `/v3/projects/9e350d3e73dd4103bbdc0dd881a0c988/users/dc268799dd1f41899430bfb8c2b728cb/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:59.638094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:59.654652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4594a61-9dfc-4233-8f22-63e78ae976a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e350d3e73dd4103bbdc0dd881a0c988, user_id=dc268799dd1f41899430bfb8c2b728cb, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:59.659569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4594a61-9dfc-4233-8f22-63e78ae976a7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:59.688952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 684/1362] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:26:59 2022] PUT /identity/v3/projects/9e350d3e73dd4103bbdc0dd881a0c988/users/dc268799dd1f41899430bfb8c2b728cb/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:26:59.700643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4e601-8b00-4401-a3bc-e1497e352cbf None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:59.700938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4e601-8b00-4401-a3bc-e1497e352cbf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:59.701268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4e601-8b00-4401-a3bc-e1497e352cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:59.751077 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f6f4e601-8b00-4401-a3bc-e1497e352cbf None None] MFA Rules not processed for user `dc268799dd1f41899430bfb8c2b728cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:59.752323 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f6f4e601-8b00-4401-a3bc-e1497e352cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:59.887043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 679/1363] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:26:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:26:59.891302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4594a61-9dfc-4233-8f22-63e78ae976a7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:00.020909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4594a61-9dfc-4233-8f22-63e78ae976a7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:00.028627 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de92ce-2d16-41c4-b626-27666e59dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:00.029451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de92ce-2d16-41c4-b626-27666e59dba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:00.029825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de92ce-2d16-41c4-b626-27666e59dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:00.030206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de92ce-2d16-41c4-b626-27666e59dba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:00.031013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de92ce-2d16-41c4-b626-27666e59dba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:00.033244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de92ce-2d16-41c4-b626-27666e59dba9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:00.073268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 685/1364] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:26:59 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:00.073925 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4e601-8b00-4401-a3bc-e1497e352cbf None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:00.088865 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4e601-8b00-4401-a3bc-e1497e352cbf None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:00.229853 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa226b32-dbea-4214-ac88-b744702946d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:00.230508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa226b32-dbea-4214-ac88-b744702946d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:00.230746 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa226b32-dbea-4214-ac88-b744702946d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:00.231139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa226b32-dbea-4214-ac88-b744702946d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:00.232016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa226b32-dbea-4214-ac88-b744702946d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:00.236344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa226b32-dbea-4214-ac88-b744702946d8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:00.286820 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 680/1365] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:00 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:00.287567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de92ce-2d16-41c4-b626-27666e59dba9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:00.305346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de92ce-2d16-41c4-b626-27666e59dba9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:00.317726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c778ea-3649-4008-be60-ed6802474fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:00.320214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c778ea-3649-4008-be60-ed6802474fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:00.320520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c778ea-3649-4008-be60-ed6802474fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:00.320961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c778ea-3649-4008-be60-ed6802474fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:00.321507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c778ea-3649-4008-be60-ed6802474fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:00.326610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c778ea-3649-4008-be60-ed6802474fbc admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:00.352169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 686/1366] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:00.356333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa226b32-dbea-4214-ac88-b744702946d8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:00.371470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa226b32-dbea-4214-ac88-b744702946d8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:00.387551 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce1313-e40e-4f11-8184-0ee5f448650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:00.388243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce1313-e40e-4f11-8184-0ee5f448650f admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:00.388519 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce1313-e40e-4f11-8184-0ee5f448650f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:00.388787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce1313-e40e-4f11-8184-0ee5f448650f admin admin] PATH_INFO: `/v3/projects/18191b1788b0420ca56e05a5a3fb8013/users/e34020289c60498fad4f4d8d3516eb12/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:00.426667 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce1313-e40e-4f11-8184-0ee5f448650f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18191b1788b0420ca56e05a5a3fb8013, user_id=e34020289c60498fad4f4d8d3516eb12, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:00.435556 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce1313-e40e-4f11-8184-0ee5f448650f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:00.463959 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 681/1367] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:00 2022] PUT /identity/v3/projects/18191b1788b0420ca56e05a5a3fb8013/users/e34020289c60498fad4f4d8d3516eb12/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:00.467627 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c778ea-3649-4008-be60-ed6802474fbc admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:00.484788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c778ea-3649-4008-be60-ed6802474fbc admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:00.649720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6bef9-fa98-4b37-ba58-438dc382f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:00.650778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6bef9-fa98-4b37-ba58-438dc382f76c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:00.651051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6bef9-fa98-4b37-ba58-438dc382f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:00.653286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6bef9-fa98-4b37-ba58-438dc382f76c admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:00.654062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6bef9-fa98-4b37-ba58-438dc382f76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:00.658473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6bef9-fa98-4b37-ba58-438dc382f76c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:00.695370 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce1313-e40e-4f11-8184-0ee5f448650f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:00.704927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 687/1368] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:00.711937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce1313-e40e-4f11-8184-0ee5f448650f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:00.731879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994e093-60e6-4320-b86f-2b23ca8209bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:00.732220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994e093-60e6-4320-b86f-2b23ca8209bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:00.732496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994e093-60e6-4320-b86f-2b23ca8209bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:00.732789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994e093-60e6-4320-b86f-2b23ca8209bd admin admin] PATH_INFO: `/v3/projects/18191b1788b0420ca56e05a5a3fb8013/users/e34020289c60498fad4f4d8d3516eb12/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:00.739727 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994e093-60e6-4320-b86f-2b23ca8209bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=18191b1788b0420ca56e05a5a3fb8013, user_id=e34020289c60498fad4f4d8d3516eb12, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:00.743755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994e093-60e6-4320-b86f-2b23ca8209bd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:00.774599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 682/1369] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:00 2022] PUT /identity/v3/projects/18191b1788b0420ca56e05a5a3fb8013/users/e34020289c60498fad4f4d8d3516eb12/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:00.787379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470b32-2353-4fef-95d5-09eae06f69de None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:00.787966 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470b32-2353-4fef-95d5-09eae06f69de None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:00.788480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470b32-2353-4fef-95d5-09eae06f69de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:00.870849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-28470b32-2353-4fef-95d5-09eae06f69de None None] MFA Rules not processed for user `e34020289c60498fad4f4d8d3516eb12`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:00.874526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-28470b32-2353-4fef-95d5-09eae06f69de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:01.016700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:01.071607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 688/1370] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:01.079371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994e093-60e6-4320-b86f-2b23ca8209bd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:01.082229 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a994e093-60e6-4320-b86f-2b23ca8209bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:01.096758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:01.174145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994e093-60e6-4320-b86f-2b23ca8209bd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:01.183215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2776a3-31e3-47bc-bda3-7b1fdeb28929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:01.184163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2776a3-31e3-47bc-bda3-7b1fdeb28929 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:01.184446 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2776a3-31e3-47bc-bda3-7b1fdeb28929 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:01.184778 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2776a3-31e3-47bc-bda3-7b1fdeb28929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:01.197531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2776a3-31e3-47bc-bda3-7b1fdeb28929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:01.199262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2776a3-31e3-47bc-bda3-7b1fdeb28929 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:01.215226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 683/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:01.247702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dda98b-efc6-42b2-a149-bb35f2b49da0 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:01.248591 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dda98b-efc6-42b2-a149-bb35f2b49da0 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:01.249039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dda98b-efc6-42b2-a149-bb35f2b49da0 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:01.250848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2776a3-31e3-47bc-bda3-7b1fdeb28929 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:01.256241 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 689/1372] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:27:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:27:01.274193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddc02d-7bdc-4ba6-89eb-44e73afb9c20 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:01.278799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddc02d-7bdc-4ba6-89eb-44e73afb9c20 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:01.279152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddc02d-7bdc-4ba6-89eb-44e73afb9c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:01.329131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-13ddc02d-7bdc-4ba6-89eb-44e73afb9c20 None None] MFA Rules not processed for user `55214b594a3f42ff8a7e0cecdef98937`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:01.330379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-13ddc02d-7bdc-4ba6-89eb-44e73afb9c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:01.404531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2776a3-31e3-47bc-bda3-7b1fdeb28929 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:01.425222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:01.426957 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:01.427348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:01.427686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] PATH_INFO: `/v3/users/dc268799dd1f41899430bfb8c2b728cb` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:01.429162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc268799dd1f41899430bfb8c2b728cb)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:01.431270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:01.450318 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 690/1373] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:27:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:01.451500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddc02d-7bdc-4ba6-89eb-44e73afb9c20 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:01.454070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-13ddc02d-7bdc-4ba6-89eb-44e73afb9c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:01.476537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddc02d-7bdc-4ba6-89eb-44e73afb9c20 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:01.489664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:01.509712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:01.510772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:01.511227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] PATH_INFO: `/v3/users/7c0fbba3e7574f678bd6afb800382c6f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:01.512876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0fbba3e7574f678bd6afb800382c6f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:01.516004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:01.537519 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc268799dd1f41899430bfb8c2b728cb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:01.554547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc268799dd1f41899430bfb8c2b728cb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:01.555502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc268799dd1f41899430bfb8c2b728cb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:01.585246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc268799dd1f41899430bfb8c2b728cb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:01.599151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc268799dd1f41899430bfb8c2b728cb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:01.608558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0fbba3e7574f678bd6afb800382c6f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:01.609455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0fbba3e7574f678bd6afb800382c6f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:01.614319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 684/1374] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:01 2022] DELETE /identity/v3/users/dc268799dd1f41899430bfb8c2b728cb => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:01.615414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:01.627751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0fbba3e7574f678bd6afb800382c6f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:01.627994 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:01.629378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0fbba3e7574f678bd6afb800382c6f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:01.651759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6711c51b-90ef-43a1-96de-a31bb0dbdfb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0fbba3e7574f678bd6afb800382c6f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:01.674835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 691/1375] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:01 2022] DELETE /identity/v3/users/7c0fbba3e7574f678bd6afb800382c6f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:01.682489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e2821-c40f-4ada-bce6-862ed3141f01 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:01.682891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e2821-c40f-4ada-bce6-862ed3141f01 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:01.683639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e2821-c40f-4ada-bce6-862ed3141f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:01.692386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:01.737883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-fb9e2821-c40f-4ada-bce6-862ed3141f01 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:01.739818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fb9e2821-c40f-4ada-bce6-862ed3141f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:01.799473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650f38b-3abd-4f86-bd2d-9e02719885dd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:01.850934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:01.874579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 692/1376] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:01.934451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e2821-c40f-4ada-bce6-862ed3141f01 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:01.936706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fb9e2821-c40f-4ada-bce6-862ed3141f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:01.975368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d19632-a88c-4984-ba93-476b3e2d28b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:01.976009 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d19632-a88c-4984-ba93-476b3e2d28b3 service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:01.976287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d19632-a88c-4984-ba93-476b3e2d28b3 service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:01.979904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d19632-a88c-4984-ba93-476b3e2d28b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:01.983132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a5d19632-a88c-4984-ba93-476b3e2d28b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:02.023101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d19632-a88c-4984-ba93-476b3e2d28b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:02.025062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d19632-a88c-4984-ba93-476b3e2d28b3 service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:02.054701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 685/1377] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:02.055410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d19632-a88c-4984-ba93-476b3e2d28b3 service placement] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:02.062198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a5d19632-a88c-4984-ba93-476b3e2d28b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:02.103995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e2821-c40f-4ada-bce6-862ed3141f01 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:02.108529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d19632-a88c-4984-ba93-476b3e2d28b3 service placement] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:02.113363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55311922-f04f-4cb9-ab65-1920da3270c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:02.113981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311922-f04f-4cb9-ab65-1920da3270c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:02.114291 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311922-f04f-4cb9-ab65-1920da3270c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:02.114486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311922-f04f-4cb9-ab65-1920da3270c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:02.119113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:02.119762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:02.120037 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:02.120305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] PATH_INFO: `/v3/users/4f181f7f91654858be10b1df11cbfaab` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:02.121975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f181f7f91654858be10b1df11cbfaab)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:02.124032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:02.144329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55311922-f04f-4cb9-ab65-1920da3270c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:02.146316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55311922-f04f-4cb9-ab65-1920da3270c7 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:02.186186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 693/1378] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:02.248397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f181f7f91654858be10b1df11cbfaab'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:02.271426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f181f7f91654858be10b1df11cbfaab'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:02.272422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f181f7f91654858be10b1df11cbfaab'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:02.317541 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f181f7f91654858be10b1df11cbfaab'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:02.324884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f181f7f91654858be10b1df11cbfaab'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:02.333511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 686/1379] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:02 2022] DELETE /identity/v3/users/4f181f7f91654858be10b1df11cbfaab => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:02.338584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c703f-f2ee-46de-9f5c-7bbce9490131 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:02.338584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c703f-f2ee-46de-9f5c-7bbce9490131 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:02.338584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c703f-f2ee-46de-9f5c-7bbce9490131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:02.374489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-122c703f-f2ee-46de-9f5c-7bbce9490131 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:02.375782 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-122c703f-f2ee-46de-9f5c-7bbce9490131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:02.505552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 694/1380] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:02.539027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:02.540670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:02.663005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:02.780063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71153efc-df0d-4e54-8137-4d2738c5f6de admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:02.790227 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca7cde-713c-4ed8-92b9-4b7307dad5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:02.795516 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca7cde-713c-4ed8-92b9-4b7307dad5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:02.798147 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca7cde-713c-4ed8-92b9-4b7307dad5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:02.798602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca7cde-713c-4ed8-92b9-4b7307dad5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:02.818721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca7cde-713c-4ed8-92b9-4b7307dad5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:02.841808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca7cde-713c-4ed8-92b9-4b7307dad5a6 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:02.859771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 687/1381] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:03.527437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c703f-f2ee-46de-9f5c-7bbce9490131 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:03.529578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-122c703f-f2ee-46de-9f5c-7bbce9490131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:03.552424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c703f-f2ee-46de-9f5c-7bbce9490131 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:03.558271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:03.559159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:03.559598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:03.560026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] PATH_INFO: `/v3/projects/58af4307f4bb48b6bdaeb336992aa171` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:03.561893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58af4307f4bb48b6bdaeb336992aa171)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:03.564374 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:03.662471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58af4307f4bb48b6bdaeb336992aa171', 'request_id': 'req-45a23fa5-a48c-4031-a1fa-925941626660'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:03.677979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58af4307f4bb48b6bdaeb336992aa171', 'request_id': 'req-45a23fa5-a48c-4031-a1fa-925941626660'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:03.695665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58af4307f4bb48b6bdaeb336992aa171', 'request_id': 'req-45a23fa5-a48c-4031-a1fa-925941626660'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:03.722121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca7cde-713c-4ed8-92b9-4b7307dad5a6 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:03.724114 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b2ca7cde-713c-4ed8-92b9-4b7307dad5a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:03.735782 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] The token cache is being invalidate because project 58af4307f4bb48b6bdaeb336992aa171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:03.736125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:03.736934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:03.739274 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 695/1382] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:03 2022] DELETE /identity/v3/projects/58af4307f4bb48b6bdaeb336992aa171 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:03.742948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:03.745352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:03.755159 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca7cde-713c-4ed8-92b9-4b7307dad5a6 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:03.786563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:03.872905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a23fa5-a48c-4031-a1fa-925941626660 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:03.878424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:03.880040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:03.880421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:03.880794 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] PATH_INFO: `/v3/users/9a0b7104e3274d7e81673f566466821f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:03.882986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0b7104e3274d7e81673f566466821f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:03.885494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:03.945850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:03.946514 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:03.953183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:03.953597 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] PATH_INFO: `/v3/projects/9e350d3e73dd4103bbdc0dd881a0c988` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:03.957098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e350d3e73dd4103bbdc0dd881a0c988)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:03.959112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:04.002417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0b7104e3274d7e81673f566466821f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.003448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0b7104e3274d7e81673f566466821f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.018448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0b7104e3274d7e81673f566466821f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.019857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0b7104e3274d7e81673f566466821f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.061698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0b7104e3274d7e81673f566466821f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.062164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e350d3e73dd4103bbdc0dd881a0c988', 'request_id': 'req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.083910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e350d3e73dd4103bbdc0dd881a0c988', 'request_id': 'req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.085379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 696/1383] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:03 2022] DELETE /identity/v3/users/9a0b7104e3274d7e81673f566466821f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:04.099320 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e350d3e73dd4103bbdc0dd881a0c988', 'request_id': 'req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.132288 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] The token cache is being invalidate because project 9e350d3e73dd4103bbdc0dd881a0c988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:04.132677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.133271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.136506 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 688/1384] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:03 2022] DELETE /identity/v3/projects/9e350d3e73dd4103bbdc0dd881a0c988 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:04.140115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:04.143668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:04.285936 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e38c5-290f-4a99-b745-a028b3121332 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:04.304639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:04.305648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:04.306253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:04.306870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] PATH_INFO: `/v3/users/e34020289c60498fad4f4d8d3516eb12` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:04.308908 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34020289c60498fad4f4d8d3516eb12)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:04.311573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:04.402992 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:04.423933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34020289c60498fad4f4d8d3516eb12'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.427233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34020289c60498fad4f4d8d3516eb12'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.449431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34020289c60498fad4f4d8d3516eb12'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.453432 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34020289c60498fad4f4d8d3516eb12'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.473524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:04.475515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:04.547417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d3733a51-c643-495c-ac17-eaa773fb39a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34020289c60498fad4f4d8d3516eb12'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:04.602096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 697/1385] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:04 2022] DELETE /identity/v3/users/e34020289c60498fad4f4d8d3516eb12 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:04.729799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67729d3e-fd6e-4e51-9358-3a6b14c49d7a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:04.756884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:04.871662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:04.872524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:04.872907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:04.873317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] PATH_INFO: `/v3/projects/0aef2e70cfd74dd58255b377b7994c31` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:04.885953 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aef2e70cfd74dd58255b377b7994c31)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:04.888080 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:05.004812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aef2e70cfd74dd58255b377b7994c31', 'request_id': 'req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:05.022157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aef2e70cfd74dd58255b377b7994c31', 'request_id': 'req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:05.029802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aef2e70cfd74dd58255b377b7994c31', 'request_id': 'req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:05.071544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] The token cache is being invalidate because project 0aef2e70cfd74dd58255b377b7994c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:05.077502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:05.080467 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a69bc2ad-f9bc-4b76-9bb0-2b755db70b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:05.091719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39542bf-5a04-4a33-94a4-607705bf4e2a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:05.092007 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39542bf-5a04-4a33-94a4-607705bf4e2a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:05.092283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39542bf-5a04-4a33-94a4-607705bf4e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:05.095566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 689/1386] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:04 2022] DELETE /identity/v3/projects/0aef2e70cfd74dd58255b377b7994c31 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:05.141814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b39542bf-5a04-4a33-94a4-607705bf4e2a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:05.146852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b39542bf-5a04-4a33-94a4-607705bf4e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:05.357539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 698/1387] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:05.366933 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbcde1-7f43-4809-98ee-35168498b576 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:05.367238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbcde1-7f43-4809-98ee-35168498b576 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:05.367486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbcde1-7f43-4809-98ee-35168498b576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:05.403982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a8fbcde1-7f43-4809-98ee-35168498b576 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:05.406248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a8fbcde1-7f43-4809-98ee-35168498b576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:05.424291 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 690/1388] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:05.424688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39542bf-5a04-4a33-94a4-607705bf4e2a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:05.444765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39542bf-5a04-4a33-94a4-607705bf4e2a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:05.464731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d920-e1ff-427c-ad1f-f5ff2650231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:05.465549 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d920-e1ff-427c-ad1f-f5ff2650231b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:05.465937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d920-e1ff-427c-ad1f-f5ff2650231b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:05.466316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d920-e1ff-427c-ad1f-f5ff2650231b admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:05.467130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656d920-e1ff-427c-ad1f-f5ff2650231b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:05.467483 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656d920-e1ff-427c-ad1f-f5ff2650231b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:05.469220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656d920-e1ff-427c-ad1f-f5ff2650231b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:05.497834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 699/1389] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:05.502089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbcde1-7f43-4809-98ee-35168498b576 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:05.530970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbcde1-7f43-4809-98ee-35168498b576 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:05.552948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1665e-4c48-49cf-bea9-56c386262833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:05.553606 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1665e-4c48-49cf-bea9-56c386262833 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:05.553879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1665e-4c48-49cf-bea9-56c386262833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:05.554148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1665e-4c48-49cf-bea9-56c386262833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:05.567492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1665e-4c48-49cf-bea9-56c386262833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:05.567492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1665e-4c48-49cf-bea9-56c386262833 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:05.631040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 691/1390] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:05 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:05.636101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d920-e1ff-427c-ad1f-f5ff2650231b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:05.682155 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d920-e1ff-427c-ad1f-f5ff2650231b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:05.701775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1665e-4c48-49cf-bea9-56c386262833 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:05.703802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dec1665e-4c48-49cf-bea9-56c386262833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:05.825408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1665e-4c48-49cf-bea9-56c386262833 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:05.843475 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:05.845918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:05.848028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:05.849327 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] PATH_INFO: `/v3/projects/dd47bd89534b47179be0f67fac29965a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:05.852317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd47bd89534b47179be0f67fac29965a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:05.860905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:05.891073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb4d52-3e66-47ee-97af-8d9c6201795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:05.893394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb4d52-3e66-47ee-97af-8d9c6201795c admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:05.895158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb4d52-3e66-47ee-97af-8d9c6201795c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:05.896173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb4d52-3e66-47ee-97af-8d9c6201795c admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:05.900189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb4d52-3e66-47ee-97af-8d9c6201795c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:05.903770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb4d52-3e66-47ee-97af-8d9c6201795c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:05.911818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:05.969670 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 700/1391] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:05 2022] POST /identity/v3/users => generated 283 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:05.974364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb4d52-3e66-47ee-97af-8d9c6201795c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:06.012756 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd47bd89534b47179be0f67fac29965a', 'request_id': 'req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:06.013001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb4d52-3e66-47ee-97af-8d9c6201795c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:06.033831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd47bd89534b47179be0f67fac29965a', 'request_id': 'req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:06.063356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd47bd89534b47179be0f67fac29965a', 'request_id': 'req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:06.090661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:06.120331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] The token cache is being invalidate because project dd47bd89534b47179be0f67fac29965a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:06.120639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:06.123816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-31414df4-5ad0-4b92-b898-4a30ffdc6e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:06.134793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 692/1392] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:05 2022] DELETE /identity/v3/projects/dd47bd89534b47179be0f67fac29965a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:06.137123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a791-91f5-450c-bb1d-3e5931159aa9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.137409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a791-91f5-450c-bb1d-3e5931159aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.139040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a791-91f5-450c-bb1d-3e5931159aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.155467 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee7b3f-7f8f-4dd9-81b6-85a747365c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:06.156263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee7b3f-7f8f-4dd9-81b6-85a747365c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.156679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee7b3f-7f8f-4dd9-81b6-85a747365c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.157114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee7b3f-7f8f-4dd9-81b6-85a747365c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.157926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee7b3f-7f8f-4dd9-81b6-85a747365c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:06.160187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee7b3f-7f8f-4dd9-81b6-85a747365c6f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:06.184800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 701/1393] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:06.185938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee7b3f-7f8f-4dd9-81b6-85a747365c6f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:06.188360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-10a6a791-91f5-450c-bb1d-3e5931159aa9 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:06.189617 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-10a6a791-91f5-450c-bb1d-3e5931159aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:06.193873 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-88ee7b3f-7f8f-4dd9-81b6-85a747365c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:06.217123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 693/1394] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:06.218259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee7b3f-7f8f-4dd9-81b6-85a747365c6f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:06.227849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca23721-186b-45a2-9b7c-17326f90fea9 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.227990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca23721-186b-45a2-9b7c-17326f90fea9 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.228317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca23721-186b-45a2-9b7c-17326f90fea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.241273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e425f65-2aae-4528-98f0-be1830edbf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:06.241974 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e425f65-2aae-4528-98f0-be1830edbf6f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.242178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e425f65-2aae-4528-98f0-be1830edbf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.243400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e425f65-2aae-4528-98f0-be1830edbf6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.243400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e425f65-2aae-4528-98f0-be1830edbf6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:06.250463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e425f65-2aae-4528-98f0-be1830edbf6f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:06.266565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2ca23721-186b-45a2-9b7c-17326f90fea9 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:06.267803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2ca23721-186b-45a2-9b7c-17326f90fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:06.291307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 694/1395] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:06.291307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca23721-186b-45a2-9b7c-17326f90fea9 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:06.291745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 702/1396] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:06.292539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e425f65-2aae-4528-98f0-be1830edbf6f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:06.309619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca23721-186b-45a2-9b7c-17326f90fea9 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:06.322621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160628b-677b-4e1c-b6ba-1305c31155dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:06.323365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160628b-677b-4e1c-b6ba-1305c31155dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.323543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160628b-677b-4e1c-b6ba-1305c31155dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.323810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160628b-677b-4e1c-b6ba-1305c31155dd admin admin] PATH_INFO: `/v3/projects/7b273e3e12024962a5ce62a448c03e7a/users/b94ab8183d2748d9b9d502b262022b05/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.324841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e425f65-2aae-4528-98f0-be1830edbf6f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:06.357403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1d1e8-373f-4561-b496-d140c3caa78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:06.358048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d1e8-373f-4561-b496-d140c3caa78b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.358318 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d1e8-373f-4561-b496-d140c3caa78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.358590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1d1e8-373f-4561-b496-d140c3caa78b admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.359244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1d1e8-373f-4561-b496-d140c3caa78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:06.359547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1d1e8-373f-4561-b496-d140c3caa78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:06.361182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1d1e8-373f-4561-b496-d140c3caa78b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:06.364690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160628b-677b-4e1c-b6ba-1305c31155dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b273e3e12024962a5ce62a448c03e7a, user_id=b94ab8183d2748d9b9d502b262022b05, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:06.373862 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160628b-677b-4e1c-b6ba-1305c31155dd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:06.382676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 703/1397] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:06.388830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1d1e8-373f-4561-b496-d140c3caa78b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:06.407713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1d1e8-373f-4561-b496-d140c3caa78b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:06.422927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91080785-a634-418f-8ddf-64f9c7062878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:06.423571 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91080785-a634-418f-8ddf-64f9c7062878 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.423826 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91080785-a634-418f-8ddf-64f9c7062878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.424109 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91080785-a634-418f-8ddf-64f9c7062878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.424733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91080785-a634-418f-8ddf-64f9c7062878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:06.426558 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 695/1398] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:06 2022] PUT /identity/v3/projects/7b273e3e12024962a5ce62a448c03e7a/users/b94ab8183d2748d9b9d502b262022b05/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:06.438591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a006081-513e-443a-a2e0-f5fccf77d739 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.438850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a006081-513e-443a-a2e0-f5fccf77d739 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.439299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a006081-513e-443a-a2e0-f5fccf77d739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.439816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91080785-a634-418f-8ddf-64f9c7062878 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:06.526197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6a006081-513e-443a-a2e0-f5fccf77d739 None None] MFA Rules not processed for user `b94ab8183d2748d9b9d502b262022b05`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:06.527815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6a006081-513e-443a-a2e0-f5fccf77d739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:06.536839 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 704/1399] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:06 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:06.538022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91080785-a634-418f-8ddf-64f9c7062878 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:06.713792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91080785-a634-418f-8ddf-64f9c7062878 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:06.726695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf91aae-82f9-452a-b39f-67226899a912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:06.727256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91aae-82f9-452a-b39f-67226899a912 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.727535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91aae-82f9-452a-b39f-67226899a912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.727801 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91aae-82f9-452a-b39f-67226899a912 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.728466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf91aae-82f9-452a-b39f-67226899a912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:06.730630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf91aae-82f9-452a-b39f-67226899a912 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:06.769190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 696/1400] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:06.769190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc94cf-8bd8-4261-a07e-b1b26f32dae2 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.775283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc94cf-8bd8-4261-a07e-b1b26f32dae2 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.776495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc94cf-8bd8-4261-a07e-b1b26f32dae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.796366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 705/1401] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:06 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:06.797673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf91aae-82f9-452a-b39f-67226899a912 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:06.830214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf91aae-82f9-452a-b39f-67226899a912 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:06.864966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-77fc94cf-8bd8-4261-a07e-b1b26f32dae2 None None] MFA Rules not processed for user `78bec0414d064ed8901271fc4c57cfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:06.866647 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebd8e1-a1ec-41b8-b963-b1679730d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:06.868982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-77fc94cf-8bd8-4261-a07e-b1b26f32dae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:06.871800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebd8e1-a1ec-41b8-b963-b1679730d4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:06.872018 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebd8e1-a1ec-41b8-b963-b1679730d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:06.873039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebd8e1-a1ec-41b8-b963-b1679730d4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:06.875476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebd8e1-a1ec-41b8-b963-b1679730d4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:06.885289 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebd8e1-a1ec-41b8-b963-b1679730d4d9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:06.984265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 706/1402] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:06 2022] POST /identity/v3/projects => generated 363 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:06.991236 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebd8e1-a1ec-41b8-b963-b1679730d4d9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:07.133071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 697/1403] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:07.133071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc94cf-8bd8-4261-a07e-b1b26f32dae2 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:07.145292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:07.165217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc94cf-8bd8-4261-a07e-b1b26f32dae2 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:07.266686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:07.300802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebd8e1-a1ec-41b8-b963-b1679730d4d9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:07.314036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38720fb4-ecbc-4048-9dee-7937606457fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:07.314662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38720fb4-ecbc-4048-9dee-7937606457fb admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:07.314938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38720fb4-ecbc-4048-9dee-7937606457fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:07.315256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38720fb4-ecbc-4048-9dee-7937606457fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:07.316554 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38720fb4-ecbc-4048-9dee-7937606457fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:07.319798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38720fb4-ecbc-4048-9dee-7937606457fb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:07.345799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c81f-6468-4c4c-9c95-decb0bb40b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:07.346455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c81f-6468-4c4c-9c95-decb0bb40b7d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:07.353713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c81f-6468-4c4c-9c95-decb0bb40b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:07.359216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c81f-6468-4c4c-9c95-decb0bb40b7d admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:07.359883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 707/1404] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:07.361302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199c81f-6468-4c4c-9c95-decb0bb40b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:07.366405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199c81f-6468-4c4c-9c95-decb0bb40b7d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:07.367533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38720fb4-ecbc-4048-9dee-7937606457fb admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:07.391231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38720fb4-ecbc-4048-9dee-7937606457fb admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:07.420630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8095d-d16e-4326-bdac-02d82976f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:07.422720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8095d-d16e-4326-bdac-02d82976f5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:07.423076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8095d-d16e-4326-bdac-02d82976f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:07.424373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8095d-d16e-4326-bdac-02d82976f5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:07.425724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8095d-d16e-4326-bdac-02d82976f5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:07.429651 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8095d-d16e-4326-bdac-02d82976f5cf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:07.442219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 698/1405] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:07 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:07.445827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c81f-6468-4c4c-9c95-decb0bb40b7d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:07.452655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c199c81f-6468-4c4c-9c95-decb0bb40b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:07.492825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 708/1406] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:07.501131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8095d-d16e-4326-bdac-02d82976f5cf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:07.508727 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c81f-6468-4c4c-9c95-decb0bb40b7d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:07.526592 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8095d-d16e-4326-bdac-02d82976f5cf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:07.529357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:07.530015 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:07.530293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:07.530623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] PATH_INFO: `/v3/projects/18191b1788b0420ca56e05a5a3fb8013` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:07.537191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=18191b1788b0420ca56e05a5a3fb8013)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:07.539421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:07.540122 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13936e15-b8f1-4cac-a642-80aa2ff24e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:07.541327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13936e15-b8f1-4cac-a642-80aa2ff24e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:07.541611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13936e15-b8f1-4cac-a642-80aa2ff24e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:07.541887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13936e15-b8f1-4cac-a642-80aa2ff24e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:07.545662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13936e15-b8f1-4cac-a642-80aa2ff24e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:07.548464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13936e15-b8f1-4cac-a642-80aa2ff24e6d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:07.587528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 709/1407] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:07.589601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13936e15-b8f1-4cac-a642-80aa2ff24e6d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:07.604510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13936e15-b8f1-4cac-a642-80aa2ff24e6d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:07.612144 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38361958-3ec1-4818-9676-a6c5bb0ff543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:07.617750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38361958-3ec1-4818-9676-a6c5bb0ff543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:07.618077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38361958-3ec1-4818-9676-a6c5bb0ff543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:07.621050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38361958-3ec1-4818-9676-a6c5bb0ff543 admin admin] PATH_INFO: `/v3/projects/8c83249fc69642ebbcfd8e7687def6eb/users/43539ccba87d4470b836327e83280216/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:07.656879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38361958-3ec1-4818-9676-a6c5bb0ff543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c83249fc69642ebbcfd8e7687def6eb, user_id=43539ccba87d4470b836327e83280216, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:07.660368 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38361958-3ec1-4818-9676-a6c5bb0ff543 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:07.673118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18191b1788b0420ca56e05a5a3fb8013', 'request_id': 'req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:07.690985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 710/1408] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:07 2022] PUT /identity/v3/projects/8c83249fc69642ebbcfd8e7687def6eb/users/43539ccba87d4470b836327e83280216/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:07.692551 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38361958-3ec1-4818-9676-a6c5bb0ff543 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:07.694074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18191b1788b0420ca56e05a5a3fb8013', 'request_id': 'req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:07.711474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18191b1788b0420ca56e05a5a3fb8013', 'request_id': 'req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:07.732785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] The token cache is being invalidate because project 18191b1788b0420ca56e05a5a3fb8013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:07.733481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:07.734331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b9713dcd-f6c9-4720-adb7-feeafe8bb5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:07.740229 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 699/1409] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:07 2022] DELETE /identity/v3/projects/18191b1788b0420ca56e05a5a3fb8013 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:07.740229 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7a902-7f0b-424d-8d59-e3d795b7565f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:07.740681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7a902-7f0b-424d-8d59-e3d795b7565f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:07.740963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7a902-7f0b-424d-8d59-e3d795b7565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:07.779866 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-bbe7a902-7f0b-424d-8d59-e3d795b7565f None None] MFA Rules not processed for user `43539ccba87d4470b836327e83280216`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:07.781249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bbe7a902-7f0b-424d-8d59-e3d795b7565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:07.859004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38361958-3ec1-4818-9676-a6c5bb0ff543 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:07.866074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785eb157-f351-4ae1-87ae-8328b371c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:07.866760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eb157-f351-4ae1-87ae-8328b371c7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:07.867270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eb157-f351-4ae1-87ae-8328b371c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:07.867551 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eb157-f351-4ae1-87ae-8328b371c7c3 admin admin] PATH_INFO: `/v3/projects/dae5628bdb044b6e8c580e6783d60bb4/users/fabe79463fae444ead8315d2b61fed84/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:07.910883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785eb157-f351-4ae1-87ae-8328b371c7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae5628bdb044b6e8c580e6783d60bb4, user_id=fabe79463fae444ead8315d2b61fed84, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:07.913626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785eb157-f351-4ae1-87ae-8328b371c7c3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:07.940065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 711/1410] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:07 2022] PUT /identity/v3/projects/dae5628bdb044b6e8c580e6783d60bb4/users/fabe79463fae444ead8315d2b61fed84/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:07.944237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7cc62-d431-4977-b4d7-c728c4f3cc62 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:07.944520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7cc62-d431-4977-b4d7-c728c4f3cc62 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:07.944913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7cc62-d431-4977-b4d7-c728c4f3cc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:07.945280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 700/1411] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:07.946241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7a902-7f0b-424d-8d59-e3d795b7565f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:07.952906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bbe7a902-7f0b-424d-8d59-e3d795b7565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:07.990259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-88d7cc62-d431-4977-b4d7-c728c4f3cc62 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:07.991414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-88d7cc62-d431-4977-b4d7-c728c4f3cc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:07.999276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:08.007401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7a902-7f0b-424d-8d59-e3d795b7565f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:08.138943 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 712/1412] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:08.138943 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7cc62-d431-4977-b4d7-c728c4f3cc62 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:08.138943 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-88d7cc62-d431-4977-b4d7-c728c4f3cc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:08.149745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7cc62-d431-4977-b4d7-c728c4f3cc62 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:08.178759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaea88c-269d-43bd-9c9e-11b02920eff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:08.179399 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea88c-269d-43bd-9c9e-11b02920eff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:08.179675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea88c-269d-43bd-9c9e-11b02920eff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:08.179942 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea88c-269d-43bd-9c9e-11b02920eff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:08.180582 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaea88c-269d-43bd-9c9e-11b02920eff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:08.182153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916333dd-83c4-4ac8-b812-2decbb15509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:08.185754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaea88c-269d-43bd-9c9e-11b02920eff3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:08.186256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916333dd-83c4-4ac8-b812-2decbb15509d admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:08.186761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916333dd-83c4-4ac8-b812-2decbb15509d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:08.187220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916333dd-83c4-4ac8-b812-2decbb15509d admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:08.191878 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916333dd-83c4-4ac8-b812-2decbb15509d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:08.196029 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916333dd-83c4-4ac8-b812-2decbb15509d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:08.232770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 701/1413] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:08.237797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02fa6-88bc-4e78-99b1-0daa602795a4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:08.238702 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02fa6-88bc-4e78-99b1-0daa602795a4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:08.238834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02fa6-88bc-4e78-99b1-0daa602795a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:08.279909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 713/1414] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:08 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:08.283073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaea88c-269d-43bd-9c9e-11b02920eff3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:08.292680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:08.297036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-51b02fa6-88bc-4e78-99b1-0daa602795a4 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:08.299605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-51b02fa6-88bc-4e78-99b1-0daa602795a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:08.436412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaea88c-269d-43bd-9c9e-11b02920eff3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:08.447757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ef81f-c4a3-467c-a7ba-804de5fade82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:08.448447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ef81f-c4a3-467c-a7ba-804de5fade82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:08.448726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ef81f-c4a3-467c-a7ba-804de5fade82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:08.449028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ef81f-c4a3-467c-a7ba-804de5fade82 admin admin] PATH_INFO: `/v3/projects/dae5628bdb044b6e8c580e6783d60bb4/users/fabe79463fae444ead8315d2b61fed84/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:08.452724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 702/1415] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:08.453636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b02fa6-88bc-4e78-99b1-0daa602795a4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:08.457496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ef81f-c4a3-467c-a7ba-804de5fade82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae5628bdb044b6e8c580e6783d60bb4, user_id=fabe79463fae444ead8315d2b61fed84, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:08.462762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ef81f-c4a3-467c-a7ba-804de5fade82 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:08.476500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b02fa6-88bc-4e78-99b1-0daa602795a4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:08.500139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 714/1416] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:08 2022] PUT /identity/v3/projects/dae5628bdb044b6e8c580e6783d60bb4/users/fabe79463fae444ead8315d2b61fed84/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:08.500139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ef81f-c4a3-467c-a7ba-804de5fade82 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:08.624279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090a2a7-abe4-489f-a48c-134f1efbc413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:08.625266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090a2a7-abe4-489f-a48c-134f1efbc413 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:08.635491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090a2a7-abe4-489f-a48c-134f1efbc413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:08.636276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090a2a7-abe4-489f-a48c-134f1efbc413 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:08.637368 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090a2a7-abe4-489f-a48c-134f1efbc413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:08.639721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090a2a7-abe4-489f-a48c-134f1efbc413 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:08.652077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ef81f-c4a3-467c-a7ba-804de5fade82 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:08.657278 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c023900-42b4-41b3-8edc-4ba7cb9c9666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:08.657912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c023900-42b4-41b3-8edc-4ba7cb9c9666 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:08.658190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c023900-42b4-41b3-8edc-4ba7cb9c9666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:08.658461 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c023900-42b4-41b3-8edc-4ba7cb9c9666 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:08.659127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c023900-42b4-41b3-8edc-4ba7cb9c9666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:08.659429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c023900-42b4-41b3-8edc-4ba7cb9c9666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:08.662030 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c023900-42b4-41b3-8edc-4ba7cb9c9666 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:08.688502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 715/1417] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:08.688502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975a80-47bd-4b0a-8318-856d042027eb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:08.688729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975a80-47bd-4b0a-8318-856d042027eb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:08.688792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c975a80-47bd-4b0a-8318-856d042027eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:08.692776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 703/1418] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:08 2022] POST /identity/v3/users => generated 296 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:08.693781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090a2a7-abe4-489f-a48c-134f1efbc413 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:08.718115 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090a2a7-abe4-489f-a48c-134f1efbc413 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:08.731638 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccee4e-e3c2-445f-9319-45c558d8d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:08.732478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccee4e-e3c2-445f-9319-45c558d8d47b admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:08.732913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccee4e-e3c2-445f-9319-45c558d8d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:08.733427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccee4e-e3c2-445f-9319-45c558d8d47b admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:08.734145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccee4e-e3c2-445f-9319-45c558d8d47b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:08.737481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccee4e-e3c2-445f-9319-45c558d8d47b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:08.766378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7c975a80-47bd-4b0a-8318-856d042027eb None None] MFA Rules not processed for user `fabe79463fae444ead8315d2b61fed84`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:08.767853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7c975a80-47bd-4b0a-8318-856d042027eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:08.803267 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 704/1419] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:08 2022] POST /identity/v3/projects => generated 401 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:08.804546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccee4e-e3c2-445f-9319-45c558d8d47b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:08.823480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:08.942433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccee4e-e3c2-445f-9319-45c558d8d47b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:08.958567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01968191-80ff-4bbf-b899-df3c392deac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:08.959215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01968191-80ff-4bbf-b899-df3c392deac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:08.959477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01968191-80ff-4bbf-b899-df3c392deac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:08.959743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01968191-80ff-4bbf-b899-df3c392deac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:08.960406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01968191-80ff-4bbf-b899-df3c392deac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:08.964219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01968191-80ff-4bbf-b899-df3c392deac5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:08.970158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 716/1420] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:08.971734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975a80-47bd-4b0a-8318-856d042027eb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:08.987148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c975a80-47bd-4b0a-8318-856d042027eb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:08.997860 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 705/1421] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:08.999647 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c14fce-2d2c-4e09-b7b7-6e66833fde4d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.000057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c14fce-2d2c-4e09-b7b7-6e66833fde4d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.000454 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c14fce-2d2c-4e09-b7b7-6e66833fde4d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.009092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 706/1422] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 2 07:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:27:09.010920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c14fce-2d2c-4e09-b7b7-6e66833fde4d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:09.015020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb150db0-db78-439b-b7f9-ea1aaabc448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:09.015541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150db0-db78-439b-b7f9-ea1aaabc448d admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.015943 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150db0-db78-439b-b7f9-ea1aaabc448d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.016315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb150db0-db78-439b-b7f9-ea1aaabc448d admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.017099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb150db0-db78-439b-b7f9-ea1aaabc448d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:09.020103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb150db0-db78-439b-b7f9-ea1aaabc448d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:09.024169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-22c14fce-2d2c-4e09-b7b7-6e66833fde4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:09.053177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:09.068509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 717/1423] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:08 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:09.069498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb150db0-db78-439b-b7f9-ea1aaabc448d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:09.087412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb150db0-db78-439b-b7f9-ea1aaabc448d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:09.099270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b3905-5c54-4096-b7c6-9244c567c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:09.100073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b3905-5c54-4096-b7c6-9244c567c98a admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.100356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b3905-5c54-4096-b7c6-9244c567c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.100621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b3905-5c54-4096-b7c6-9244c567c98a admin admin] PATH_INFO: `/v3/projects/21454b928e6e405cba3343ac6ab94ac5/users/687e3fa28d9e47f8a64ea497c76d5d0c/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.133876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c14fce-2d2c-4e09-b7b7-6e66833fde4d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:09.140473 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da03318-3979-4348-9047-d306617344c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:09.141150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03318-3979-4348-9047-d306617344c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.141433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03318-3979-4348-9047-d306617344c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.141706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da03318-3979-4348-9047-d306617344c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.152749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b3905-5c54-4096-b7c6-9244c567c98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21454b928e6e405cba3343ac6ab94ac5, user_id=687e3fa28d9e47f8a64ea497c76d5d0c, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:09.157785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b3905-5c54-4096-b7c6-9244c567c98a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:09.185033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 718/1424] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:09 2022] PUT /identity/v3/projects/21454b928e6e405cba3343ac6ab94ac5/users/687e3fa28d9e47f8a64ea497c76d5d0c/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:09.188358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d228e-0ada-4ec4-ad36-6309cc4a7292 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.188358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d228e-0ada-4ec4-ad36-6309cc4a7292 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.189562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d228e-0ada-4ec4-ad36-6309cc4a7292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.274261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ac9d228e-0ada-4ec4-ad36-6309cc4a7292 None None] MFA Rules not processed for user `7f1a24bf15594b12bbf59741fcb46cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:09.275568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ac9d228e-0ada-4ec4-ad36-6309cc4a7292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:09.298483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da03318-3979-4348-9047-d306617344c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:09.303430 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da03318-3979-4348-9047-d306617344c8 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:09.327170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 707/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:09.328124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da03318-3979-4348-9047-d306617344c8 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:09.344743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da03318-3979-4348-9047-d306617344c8 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:09.449413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 719/1426] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:27:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:09.450507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d228e-0ada-4ec4-ad36-6309cc4a7292 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:09.530241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:09.552523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b4bcd-2b61-418c-a35a-4675b81b4d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:09.553192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b4bcd-2b61-418c-a35a-4675b81b4d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.553470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b4bcd-2b61-418c-a35a-4675b81b4d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.553908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b4bcd-2b61-418c-a35a-4675b81b4d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.554561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b4bcd-2b61-418c-a35a-4675b81b4d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:09.556867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b4bcd-2b61-418c-a35a-4675b81b4d67 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:09.571645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 708/1427] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:09.571645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b4bcd-2b61-418c-a35a-4675b81b4d67 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:09.573316 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5b3b4bcd-2b61-418c-a35a-4675b81b4d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:09.605460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b4bcd-2b61-418c-a35a-4675b81b4d67 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:09.607610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d228e-0ada-4ec4-ad36-6309cc4a7292 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:09.613570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78a07f-433a-4b5e-84f9-e6d0a046eff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:09.614891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78a07f-433a-4b5e-84f9-e6d0a046eff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.615372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78a07f-433a-4b5e-84f9-e6d0a046eff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.616594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78a07f-433a-4b5e-84f9-e6d0a046eff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.617480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78a07f-433a-4b5e-84f9-e6d0a046eff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:09.619526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78a07f-433a-4b5e-84f9-e6d0a046eff9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:09.622080 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69085a9-f5ef-4b42-a3de-7476eebc1825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:09.622797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69085a9-f5ef-4b42-a3de-7476eebc1825 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.623082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69085a9-f5ef-4b42-a3de-7476eebc1825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.623352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69085a9-f5ef-4b42-a3de-7476eebc1825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.636106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69085a9-f5ef-4b42-a3de-7476eebc1825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:09.639267 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69085a9-f5ef-4b42-a3de-7476eebc1825 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:09.646210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 720/1428] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:09.647195 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78a07f-433a-4b5e-84f9-e6d0a046eff9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:09.660860 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 709/1429] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:09.662833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69085a9-f5ef-4b42-a3de-7476eebc1825 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:09.666759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d69085a9-f5ef-4b42-a3de-7476eebc1825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:09.668003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78a07f-433a-4b5e-84f9-e6d0a046eff9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:09.680227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fd654-25c9-4b6e-8d5d-a3c4bfbebdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:09.681027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fd654-25c9-4b6e-8d5d-a3c4bfbebdfd admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.681509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fd654-25c9-4b6e-8d5d-a3c4bfbebdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.683898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fd654-25c9-4b6e-8d5d-a3c4bfbebdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.684077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fd654-25c9-4b6e-8d5d-a3c4bfbebdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:09.687918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fd654-25c9-4b6e-8d5d-a3c4bfbebdfd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:09.724376 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 721/1430] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:09.726013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fd654-25c9-4b6e-8d5d-a3c4bfbebdfd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:09.746357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fd654-25c9-4b6e-8d5d-a3c4bfbebdfd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:09.754324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde11f2-e206-4278-b4d4-377db651ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:09.755205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde11f2-e206-4278-b4d4-377db651ecbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.755624 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde11f2-e206-4278-b4d4-377db651ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.756697 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde11f2-e206-4278-b4d4-377db651ecbc admin admin] PATH_INFO: `/v3/projects/21454b928e6e405cba3343ac6ab94ac5/users/687e3fa28d9e47f8a64ea497c76d5d0c/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.759830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde11f2-e206-4278-b4d4-377db651ecbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=21454b928e6e405cba3343ac6ab94ac5, user_id=687e3fa28d9e47f8a64ea497c76d5d0c, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:09.763215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde11f2-e206-4278-b4d4-377db651ecbc admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:09.786532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 722/1431] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:09 2022] PUT /identity/v3/projects/21454b928e6e405cba3343ac6ab94ac5/users/687e3fa28d9e47f8a64ea497c76d5d0c/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:09.787681 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde11f2-e206-4278-b4d4-377db651ecbc admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:09.843968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69085a9-f5ef-4b42-a3de-7476eebc1825 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:09.892119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:09.950696 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde11f2-e206-4278-b4d4-377db651ecbc admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:09.956814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8e6fa-a9b8-44c5-93cf-5418bf22ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:09.958214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8e6fa-a9b8-44c5-93cf-5418bf22ce21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.958690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8e6fa-a9b8-44c5-93cf-5418bf22ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.959142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8e6fa-a9b8-44c5-93cf-5418bf22ce21 admin admin] PATH_INFO: `/v3/projects/835af284442045d59595416a598ff681/users/f8729c3db0c94b97a2ec7ca31ec420ab/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.972673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd3652-9de6-4299-a1b2-db3a0bc4244f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:09.974672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd3652-9de6-4299-a1b2-db3a0bc4244f service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:09.975135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd3652-9de6-4299-a1b2-db3a0bc4244f service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:09.976767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd3652-9de6-4299-a1b2-db3a0bc4244f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:09.979488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-89bd3652-9de6-4299-a1b2-db3a0bc4244f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:09.997070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8e6fa-a9b8-44c5-93cf-5418bf22ce21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835af284442045d59595416a598ff681, user_id=f8729c3db0c94b97a2ec7ca31ec420ab, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:10.002473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8e6fa-a9b8-44c5-93cf-5418bf22ce21 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:10.032279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 723/1432] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:09 2022] PUT /identity/v3/projects/835af284442045d59595416a598ff681/users/f8729c3db0c94b97a2ec7ca31ec420ab/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:10.035972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0fb26-bc7c-4d87-b8f4-c98fab6c00f2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:10.036807 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0fb26-bc7c-4d87-b8f4-c98fab6c00f2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:10.037207 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0fb26-bc7c-4d87-b8f4-c98fab6c00f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:10.106968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd3652-9de6-4299-a1b2-db3a0bc4244f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:10.108670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd3652-9de6-4299-a1b2-db3a0bc4244f service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:10.109954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-83b0fb26-bc7c-4d87-b8f4-c98fab6c00f2 None None] MFA Rules not processed for user `eb19406216904864b983404a0ce65e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:10.111190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-83b0fb26-bc7c-4d87-b8f4-c98fab6c00f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:10.132600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 710/1433] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:10.134252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266370ef-07bb-4b8a-91b2-6fa557daf857 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:10.137124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266370ef-07bb-4b8a-91b2-6fa557daf857 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:10.137416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266370ef-07bb-4b8a-91b2-6fa557daf857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:10.197170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-266370ef-07bb-4b8a-91b2-6fa557daf857 None None] MFA Rules not processed for user `687e3fa28d9e47f8a64ea497c76d5d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:10.198414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-266370ef-07bb-4b8a-91b2-6fa557daf857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:10.300643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:10.354333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 724/1434] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:10.358481 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23423052-2a0f-4de6-9c3d-8d7a63477849 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:10.358924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23423052-2a0f-4de6-9c3d-8d7a63477849 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:10.359900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23423052-2a0f-4de6-9c3d-8d7a63477849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:10.372248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 711/1435] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:10.373640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ff721-af25-4953-9a66-65f30f232f93 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:10.373913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ff721-af25-4953-9a66-65f30f232f93 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:10.374724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ff721-af25-4953-9a66-65f30f232f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:10.418576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-23423052-2a0f-4de6-9c3d-8d7a63477849 None None] MFA Rules not processed for user `4eba12ea4c4245099fea1e3be288c683`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:10.420301 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-23423052-2a0f-4de6-9c3d-8d7a63477849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:10.422999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7d5ff721-af25-4953-9a66-65f30f232f93 None None] MFA Rules not processed for user `f8729c3db0c94b97a2ec7ca31ec420ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:10.424304 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7d5ff721-af25-4953-9a66-65f30f232f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:10.543405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 712/1436] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:10 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:10.543405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4067-8567-42eb-8cff-2cfbae304f34 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:10.543405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4067-8567-42eb-8cff-2cfbae304f34 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:10.543405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4067-8567-42eb-8cff-2cfbae304f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:10.583954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-314b4067-8567-42eb-8cff-2cfbae304f34 None None] MFA Rules not processed for user `855713a466914a84bd3697a308a8ed20`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:10.585787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-314b4067-8567-42eb-8cff-2cfbae304f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:10.590560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 725/1437] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:10.594644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23423052-2a0f-4de6-9c3d-8d7a63477849 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:10.600409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-23423052-2a0f-4de6-9c3d-8d7a63477849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:10.716048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:10.762074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 713/1438] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:10.762074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4067-8567-42eb-8cff-2cfbae304f34 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:10.815848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23423052-2a0f-4de6-9c3d-8d7a63477849 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:10.839036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054d4bb-5a41-471e-b26a-1d629a87e4fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:10.840388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054d4bb-5a41-471e-b26a-1d629a87e4fc service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:10.840667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054d4bb-5a41-471e-b26a-1d629a87e4fc service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:10.843467 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054d4bb-5a41-471e-b26a-1d629a87e4fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:10.866273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054d4bb-5a41-471e-b26a-1d629a87e4fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:10.867902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9054d4bb-5a41-471e-b26a-1d629a87e4fc service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:10.907133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 726/1439] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:10.909040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054d4bb-5a41-471e-b26a-1d629a87e4fc service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:10.931256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4067-8567-42eb-8cff-2cfbae304f34 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:10.938324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336df71-a1ce-49c1-82ce-82ae9e37922c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:10.941354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336df71-a1ce-49c1-82ce-82ae9e37922c service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:10.941726 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336df71-a1ce-49c1-82ce-82ae9e37922c service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:10.941899 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336df71-a1ce-49c1-82ce-82ae9e37922c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:10.960816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:10.967898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336df71-a1ce-49c1-82ce-82ae9e37922c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:10.969936 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336df71-a1ce-49c1-82ce-82ae9e37922c service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:11.003900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 714/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:11.005850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b5f16-67fa-41ee-a120-a6ccc88b36b5 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:11.006539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b5f16-67fa-41ee-a120-a6ccc88b36b5 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:11.007032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b5f16-67fa-41ee-a120-a6ccc88b36b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:11.061429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d19b5f16-67fa-41ee-a120-a6ccc88b36b5 None None] MFA Rules not processed for user `4eba12ea4c4245099fea1e3be288c683`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:11.066751 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d19b5f16-67fa-41ee-a120-a6ccc88b36b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:11.078540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 715/1441] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:11.081306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a291104-a499-40ca-a166-99c9937ef0be None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:11.082159 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a291104-a499-40ca-a166-99c9937ef0be None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:11.082432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a291104-a499-40ca-a166-99c9937ef0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:11.113044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054d4bb-5a41-471e-b26a-1d629a87e4fc service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:11.127508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2a291104-a499-40ca-a166-99c9937ef0be None None] MFA Rules not processed for user `855713a466914a84bd3697a308a8ed20`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:11.130049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2a291104-a499-40ca-a166-99c9937ef0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:11.135348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3e669-8025-4a9d-8d7e-841307b603b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:11.137106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e669-8025-4a9d-8d7e-841307b603b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:11.139458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e669-8025-4a9d-8d7e-841307b603b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:11.141499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e669-8025-4a9d-8d7e-841307b603b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:11.142353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e669-8025-4a9d-8d7e-841307b603b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:11.148741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 716/1442] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:11.154964 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e669-8025-4a9d-8d7e-841307b603b3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:11.155365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a291104-a499-40ca-a166-99c9937ef0be None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:11.158253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2a291104-a499-40ca-a166-99c9937ef0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:11.228899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 727/1443] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:10 2022] POST /identity/v3/projects => generated 399 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:11.229362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3e669-8025-4a9d-8d7e-841307b603b3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:11.236306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-26d3e669-8025-4a9d-8d7e-841307b603b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:11.504166 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a291104-a499-40ca-a166-99c9937ef0be None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:11.526758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3e669-8025-4a9d-8d7e-841307b603b3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:11.559320 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c496f61-34b4-4bab-818d-963dad388f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:11.565103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c496f61-34b4-4bab-818d-963dad388f49 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:11.565103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c496f61-34b4-4bab-818d-963dad388f49 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:11.565103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c496f61-34b4-4bab-818d-963dad388f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:11.698472 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d425c-a638-4ec2-a618-3c5fae4132b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:11.700695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d425c-a638-4ec2-a618-3c5fae4132b5 service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:11.701236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d425c-a638-4ec2-a618-3c5fae4132b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:11.701656 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d425c-a638-4ec2-a618-3c5fae4132b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:11.704265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fd8d425c-a638-4ec2-a618-3c5fae4132b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:11.705059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:11.724008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c496f61-34b4-4bab-818d-963dad388f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:11.729561 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c496f61-34b4-4bab-818d-963dad388f49 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:11.734400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d425c-a638-4ec2-a618-3c5fae4132b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:11.739057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d425c-a638-4ec2-a618-3c5fae4132b5 service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:11.751418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 728/1444] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:11.767521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c496f61-34b4-4bab-818d-963dad388f49 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:11.777338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 717/1445] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:11.778621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d425c-a638-4ec2-a618-3c5fae4132b5 service placement] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:11.808466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c496f61-34b4-4bab-818d-963dad388f49 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:11.843032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02360c43-b4ad-4b36-9559-85c2b7e3c72b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:11.846000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360c43-b4ad-4b36-9559-85c2b7e3c72b service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:11.847884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360c43-b4ad-4b36-9559-85c2b7e3c72b service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:11.848707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02360c43-b4ad-4b36-9559-85c2b7e3c72b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:12.003689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d425c-a638-4ec2-a618-3c5fae4132b5 service placement] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:12.014795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feced1-0d7b-4c59-b79c-ed728f12af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:12.015485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feced1-0d7b-4c59-b79c-ed728f12af03 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:12.015722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feced1-0d7b-4c59-b79c-ed728f12af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:12.016258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feced1-0d7b-4c59-b79c-ed728f12af03 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:12.016594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feced1-0d7b-4c59-b79c-ed728f12af03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:12.018566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feced1-0d7b-4c59-b79c-ed728f12af03 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:12.048887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02360c43-b4ad-4b36-9559-85c2b7e3c72b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:12.053329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02360c43-b4ad-4b36-9559-85c2b7e3c72b service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:12.073266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 718/1446] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:11 2022] POST /identity/v3/users => generated 306 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:12.074535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feced1-0d7b-4c59-b79c-ed728f12af03 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:12.083629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:12.103599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 729/1447] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:12.104632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02360c43-b4ad-4b36-9559-85c2b7e3c72b service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:12.145948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02360c43-b4ad-4b36-9559-85c2b7e3c72b service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:12.164817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5973a-ce82-4aeb-8bc1-cf390374e537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:12.168082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5973a-ce82-4aeb-8bc1-cf390374e537 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:12.168442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5973a-ce82-4aeb-8bc1-cf390374e537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:12.170515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5973a-ce82-4aeb-8bc1-cf390374e537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:12.174079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5973a-ce82-4aeb-8bc1-cf390374e537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:12.182063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5973a-ce82-4aeb-8bc1-cf390374e537 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:12.215496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 730/1448] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:12.219152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5973a-ce82-4aeb-8bc1-cf390374e537 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:12.267711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feced1-0d7b-4c59-b79c-ed728f12af03 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:12.284372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5973a-ce82-4aeb-8bc1-cf390374e537 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:12.300272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbb495-6f11-4aa3-add6-084559400261 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687e3fa28d9e47f8a64ea497c76d5d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21454b928e6e405cba3343ac6ab94ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:12.302946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb495-6f11-4aa3-add6-084559400261 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:12.304343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb495-6f11-4aa3-add6-084559400261 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:12.304619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb495-6f11-4aa3-add6-084559400261 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:12.305961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf0ad5-da72-456c-b3f9-594f1a5c3605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:12.307871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf0ad5-da72-456c-b3f9-594f1a5c3605 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:12.310560 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbb495-6f11-4aa3-add6-084559400261 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:12.310890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbb495-6f11-4aa3-add6-084559400261 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:12.311288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf0ad5-da72-456c-b3f9-594f1a5c3605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:12.311576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf0ad5-da72-456c-b3f9-594f1a5c3605 admin admin] PATH_INFO: `/v3/projects/5cce0aa2fb4142af805d923606bd5aba/users/33de5513fa974699aa8064a94ee7c73e/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:12.316915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbb495-6f11-4aa3-add6-084559400261 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:12.360445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf0ad5-da72-456c-b3f9-594f1a5c3605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cce0aa2fb4142af805d923606bd5aba, user_id=33de5513fa974699aa8064a94ee7c73e, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:12.370523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 719/1449] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:12.373557 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbb495-6f11-4aa3-add6-084559400261 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:12.373740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf0ad5-da72-456c-b3f9-594f1a5c3605 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:12.406573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbb495-6f11-4aa3-add6-084559400261 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:12.461357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 731/1450] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:12 2022] PUT /identity/v3/projects/5cce0aa2fb4142af805d923606bd5aba/users/33de5513fa974699aa8064a94ee7c73e/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:12.465932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf0ad5-da72-456c-b3f9-594f1a5c3605 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:12.585818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cf1a3-9f38-4c92-b162-ce59fee97ee1 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687e3fa28d9e47f8a64ea497c76d5d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21454b928e6e405cba3343ac6ab94ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:12.586791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cf1a3-9f38-4c92-b162-ce59fee97ee1 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:12.587234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cf1a3-9f38-4c92-b162-ce59fee97ee1 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:12.587737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cf1a3-9f38-4c92-b162-ce59fee97ee1 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:12.588583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cf1a3-9f38-4c92-b162-ce59fee97ee1 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:12.590753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cf1a3-9f38-4c92-b162-ce59fee97ee1 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:12.633087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 720/1451] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:12 2022] POST /identity/v3/projects => generated 354 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:12.636553 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cf1a3-9f38-4c92-b162-ce59fee97ee1 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:12.659432 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf0ad5-da72-456c-b3f9-594f1a5c3605 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:12.802262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cf1a3-9f38-4c92-b162-ce59fee97ee1 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:12.815215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23912e-6ef3-4ed2-aeaf-56d38ba604d9 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687e3fa28d9e47f8a64ea497c76d5d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21454b928e6e405cba3343ac6ab94ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:12.817560 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23912e-6ef3-4ed2-aeaf-56d38ba604d9 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:12.817864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23912e-6ef3-4ed2-aeaf-56d38ba604d9 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:12.818045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d79ff-ffa6-470b-8765-fd513cd940e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:12.818165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23912e-6ef3-4ed2-aeaf-56d38ba604d9 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:12.818803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23912e-6ef3-4ed2-aeaf-56d38ba604d9 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:12.819052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d79ff-ffa6-470b-8765-fd513cd940e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:12.819155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23912e-6ef3-4ed2-aeaf-56d38ba604d9 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:12.819859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d79ff-ffa6-470b-8765-fd513cd940e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:12.820394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d79ff-ffa6-470b-8765-fd513cd940e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:12.822541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d79ff-ffa6-470b-8765-fd513cd940e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:12.823610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23912e-6ef3-4ed2-aeaf-56d38ba604d9 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:12.825796 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d79ff-ffa6-470b-8765-fd513cd940e4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:12.834452 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:12.852891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 732/1452] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:12.856007 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d79ff-ffa6-470b-8765-fd513cd940e4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:12.866124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 721/1453] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:12.881317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d79ff-ffa6-470b-8765-fd513cd940e4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:12.902974 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3160a4b-289e-4a78-96b1-b7acb1d3de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:12.904733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160a4b-289e-4a78-96b1-b7acb1d3de55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:12.910374 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160a4b-289e-4a78-96b1-b7acb1d3de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:12.910864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160a4b-289e-4a78-96b1-b7acb1d3de55 admin admin] PATH_INFO: `/v3/projects/5cce0aa2fb4142af805d923606bd5aba/users/33de5513fa974699aa8064a94ee7c73e/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:12.915924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160a4b-289e-4a78-96b1-b7acb1d3de55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cce0aa2fb4142af805d923606bd5aba, user_id=33de5513fa974699aa8064a94ee7c73e, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:12.927620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160a4b-289e-4a78-96b1-b7acb1d3de55 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:12.965846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 733/1454] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:12 2022] PUT /identity/v3/projects/5cce0aa2fb4142af805d923606bd5aba/users/33de5513fa974699aa8064a94ee7c73e/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:12.980646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ef3e-605f-482a-8d08-53275a4c27ea None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:12.980974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ef3e-605f-482a-8d08-53275a4c27ea None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:12.981237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ef3e-605f-482a-8d08-53275a4c27ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:12.995738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3160a4b-289e-4a78-96b1-b7acb1d3de55 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:13.073474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-86e4ef3e-605f-482a-8d08-53275a4c27ea None None] MFA Rules not processed for user `33de5513fa974699aa8064a94ee7c73e`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:13.074666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-86e4ef3e-605f-482a-8d08-53275a4c27ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:13.099397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:13.152838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3160a4b-289e-4a78-96b1-b7acb1d3de55 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:13.157928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '687e3fa28d9e47f8a64ea497c76d5d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21454b928e6e405cba3343ac6ab94ac5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:13.158576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:13.158855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:13.159124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] PATH_INFO: `/v3/projects/57c09115253b40bb99bd9fb436433417` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:13.160632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: Authorizing `identity:delete_project(project_id=57c09115253b40bb99bd9fb436433417)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:13.162612 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:13.282707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c09115253b40bb99bd9fb436433417', 'request_id': 'req-1c542b43-d2af-4ff7-a9f4-811a3453d535'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:13.299749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c09115253b40bb99bd9fb436433417', 'request_id': 'req-1c542b43-d2af-4ff7-a9f4-811a3453d535'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:13.317809 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c09115253b40bb99bd9fb436433417', 'request_id': 'req-1c542b43-d2af-4ff7-a9f4-811a3453d535'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:13.345418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] The token cache is being invalidate because project 57c09115253b40bb99bd9fb436433417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:13.345919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:13.346712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c542b43-d2af-4ff7-a9f4-811a3453d535 tempest-VolumeQuotaClassesTest-869431390 tempest-VolumeQuotaClassesTest-869431390-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:13.353313 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 734/1455] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:12 2022] DELETE /identity/v3/projects/57c09115253b40bb99bd9fb436433417 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:13.356819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130afb46-a42e-4ed1-b231-0a8330d3f805 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:13.358096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130afb46-a42e-4ed1-b231-0a8330d3f805 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:13.358500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130afb46-a42e-4ed1-b231-0a8330d3f805 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:13.362526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 735/1456] 10.222.0.13 () {54 vars in 912 bytes} [Wed Nov 2 07:27:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:27:13.369885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684e895-9577-4e8e-8720-fc0f9e05fa43 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:13.370371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684e895-9577-4e8e-8720-fc0f9e05fa43 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:13.370896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684e895-9577-4e8e-8720-fc0f9e05fa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:13.380551 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 722/1457] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:27:13.402396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4ef3e-605f-482a-8d08-53275a4c27ea None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:13.420346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5684e895-9577-4e8e-8720-fc0f9e05fa43 None None] MFA Rules not processed for user `7f1a24bf15594b12bbf59741fcb46cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:13.426062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5684e895-9577-4e8e-8720-fc0f9e05fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:13.526166 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4ef3e-605f-482a-8d08-53275a4c27ea None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:13.577913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 736/1458] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:27:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:13.600958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684e895-9577-4e8e-8720-fc0f9e05fa43 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:13.603549 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5684e895-9577-4e8e-8720-fc0f9e05fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:13.622101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684e895-9577-4e8e-8720-fc0f9e05fa43 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:13.632540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7974a-41a0-4bc2-be82-f3c7beee72fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:13.633220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7974a-41a0-4bc2-be82-f3c7beee72fb service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:13.634573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7974a-41a0-4bc2-be82-f3c7beee72fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:13.636744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7974a-41a0-4bc2-be82-f3c7beee72fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:13.656069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7974a-41a0-4bc2-be82-f3c7beee72fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:13.658177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7974a-41a0-4bc2-be82-f3c7beee72fb service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:13.659097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d641c6-aaf7-4993-a99a-ace2ab7d0e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:13.660342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d641c6-aaf7-4993-a99a-ace2ab7d0e6a service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:13.660699 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d641c6-aaf7-4993-a99a-ace2ab7d0e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:13.660931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d641c6-aaf7-4993-a99a-ace2ab7d0e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:13.669925 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-94d641c6-aaf7-4993-a99a-ace2ab7d0e6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:13.678992 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 737/1459] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:13.860950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d641c6-aaf7-4993-a99a-ace2ab7d0e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:13.863420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d641c6-aaf7-4993-a99a-ace2ab7d0e6a service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:13.898199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 723/1460] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:14.227471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7974a-41a0-4bc2-be82-f3c7beee72fb service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:14.230311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-77c7974a-41a0-4bc2-be82-f3c7beee72fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:14.238223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d641c6-aaf7-4993-a99a-ace2ab7d0e6a service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:14.239687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-94d641c6-aaf7-4993-a99a-ace2ab7d0e6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:14.256474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:14.257780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d641c6-aaf7-4993-a99a-ace2ab7d0e6a service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:14.280861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7806f2-9003-4340-846b-93933f4163c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:14.281933 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7806f2-9003-4340-846b-93933f4163c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:14.282173 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7806f2-9003-4340-846b-93933f4163c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:14.282402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7806f2-9003-4340-846b-93933f4163c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:14.285782 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cc7806f2-9003-4340-846b-93933f4163c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:14.298739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:14.449977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7974a-41a0-4bc2-be82-f3c7beee72fb service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:14.469340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:14.469989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:14.470263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:14.470532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] PATH_INFO: `/v3/users/43539ccba87d4470b836327e83280216` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:14.477456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7806f2-9003-4340-846b-93933f4163c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:14.479026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7806f2-9003-4340-846b-93933f4163c5 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:14.479686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43539ccba87d4470b836327e83280216)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:14.495014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:14.498456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 724/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:14 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:14.645449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43539ccba87d4470b836327e83280216'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:14.646709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43539ccba87d4470b836327e83280216'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:14.678457 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43539ccba87d4470b836327e83280216'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:14.681412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43539ccba87d4470b836327e83280216'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:14.724640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fbc72715-97d8-4c31-bae5-ca2e8ab6b423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43539ccba87d4470b836327e83280216'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:14.752849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 738/1462] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:14 2022] DELETE /identity/v3/users/43539ccba87d4470b836327e83280216 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:14.757935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f273d83-11f6-469d-8c3e-b381693cb697 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:14.758417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f273d83-11f6-469d-8c3e-b381693cb697 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:14.758831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f273d83-11f6-469d-8c3e-b381693cb697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:14.792295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3f273d83-11f6-469d-8c3e-b381693cb697 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:14.795417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3f273d83-11f6-469d-8c3e-b381693cb697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:14.943252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfd404-f129-40dc-b907-0f3d0b3d66c9 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:14.943252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfd404-f129-40dc-b907-0f3d0b3d66c9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:14.943252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfd404-f129-40dc-b907-0f3d0b3d66c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:15.009393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-becfd404-f129-40dc-b907-0f3d0b3d66c9 None None] MFA Rules not processed for user `4eba12ea4c4245099fea1e3be288c683`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:15.010657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-becfd404-f129-40dc-b907-0f3d0b3d66c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:15.113537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 725/1463] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:15.195208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f273d83-11f6-469d-8c3e-b381693cb697 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:15.196892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3f273d83-11f6-469d-8c3e-b381693cb697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:15.252665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 739/1464] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:27:15.382145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f273d83-11f6-469d-8c3e-b381693cb697 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:15.399572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd71c4-fcf0-4805-bbb1-b53397a45aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:15.400768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd71c4-fcf0-4805-bbb1-b53397a45aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:15.401329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd71c4-fcf0-4805-bbb1-b53397a45aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:15.401844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd71c4-fcf0-4805-bbb1-b53397a45aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:15.450083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd71c4-fcf0-4805-bbb1-b53397a45aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:15.451686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd71c4-fcf0-4805-bbb1-b53397a45aa0 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:15.492941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 726/1465] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:15.739079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4665992-35bf-4e4d-a803-97ef7ed19cf4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:15.739635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4665992-35bf-4e4d-a803-97ef7ed19cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:15.740044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4665992-35bf-4e4d-a803-97ef7ed19cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:15.960304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d4665992-35bf-4e4d-a803-97ef7ed19cf4 None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:15.962359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d4665992-35bf-4e4d-a803-97ef7ed19cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:15.981608 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:16.205537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 740/1466] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:27:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:16.501270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd71c4-fcf0-4805-bbb1-b53397a45aa0 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:16.503651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e6cd71c4-fcf0-4805-bbb1-b53397a45aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:16.651944 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:16.717566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd71c4-fcf0-4805-bbb1-b53397a45aa0 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:16.724625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2243-e3f7-4e73-96ab-93c3571bb19f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:16.726539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2243-e3f7-4e73-96ab-93c3571bb19f service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:16.727025 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2243-e3f7-4e73-96ab-93c3571bb19f service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:16.727646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2243-e3f7-4e73-96ab-93c3571bb19f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:16.747329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f2243-e3f7-4e73-96ab-93c3571bb19f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:16.749500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f2243-e3f7-4e73-96ab-93c3571bb19f service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:16.775081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 727/1467] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:27:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:27:17.334885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ae631-2230-4a75-aab2-6b27d71e9e44 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:17.335458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ae631-2230-4a75-aab2-6b27d71e9e44 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:17.335458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ae631-2230-4a75-aab2-6b27d71e9e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:17.398158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a26ae631-2230-4a75-aab2-6b27d71e9e44 None None] MFA Rules not processed for user `eb19406216904864b983404a0ce65e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:17.402618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a26ae631-2230-4a75-aab2-6b27d71e9e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:17.752456 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 741/1468] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:18.165783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2243-e3f7-4e73-96ab-93c3571bb19f service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:18.167799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-814f2243-e3f7-4e73-96ab-93c3571bb19f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:18.189962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2243-e3f7-4e73-96ab-93c3571bb19f service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:18.203405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:18.204055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:18.204335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:18.204594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] PATH_INFO: `/v3/projects/8c83249fc69642ebbcfd8e7687def6eb` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:18.211439 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c83249fc69642ebbcfd8e7687def6eb)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:18.213737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:18.323357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c83249fc69642ebbcfd8e7687def6eb', 'request_id': 'req-5c569971-fe9e-4b9c-9258-565857c374ae'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:18.341711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c83249fc69642ebbcfd8e7687def6eb', 'request_id': 'req-5c569971-fe9e-4b9c-9258-565857c374ae'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:18.363574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c83249fc69642ebbcfd8e7687def6eb', 'request_id': 'req-5c569971-fe9e-4b9c-9258-565857c374ae'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:18.398486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] The token cache is being invalidate because project 8c83249fc69642ebbcfd8e7687def6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:18.399374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:18.401418 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5c569971-fe9e-4b9c-9258-565857c374ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:18.411422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ae631-2230-4a75-aab2-6b27d71e9e44 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:18.412369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 728/1469] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:18 2022] DELETE /identity/v3/projects/8c83249fc69642ebbcfd8e7687def6eb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:18.430004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ae631-2230-4a75-aab2-6b27d71e9e44 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:18.643193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:18.644365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:18.648661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:18.649099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] PATH_INFO: `/v3/users/687e3fa28d9e47f8a64ea497c76d5d0c` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:18.651472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687e3fa28d9e47f8a64ea497c76d5d0c)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:18.654773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:18.773751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687e3fa28d9e47f8a64ea497c76d5d0c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:18.775046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687e3fa28d9e47f8a64ea497c76d5d0c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:18.790164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:18.796933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687e3fa28d9e47f8a64ea497c76d5d0c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:18.798499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687e3fa28d9e47f8a64ea497c76d5d0c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:18.857233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687e3fa28d9e47f8a64ea497c76d5d0c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:18.935501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 742/1470] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:18 2022] DELETE /identity/v3/users/687e3fa28d9e47f8a64ea497c76d5d0c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:20.038748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d8f0-051f-4786-a205-d7582db1195a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:20.039297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d8f0-051f-4786-a205-d7582db1195a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:20.039297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d8f0-051f-4786-a205-d7582db1195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:20.122564 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e652d8f0-051f-4786-a205-d7582db1195a None None] MFA Rules not processed for user `7f1a24bf15594b12bbf59741fcb46cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:20.143012 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e652d8f0-051f-4786-a205-d7582db1195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:20.414307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 729/1471] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Nov 2 07:27:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:20.456999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:20.458488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:20.484809 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8dae-f8b6-44fe-8189-b465053c6a15 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:20.505545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec029-e9c1-47f1-bf96-7e6b4de5a32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:20.513219 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec029-e9c1-47f1-bf96-7e6b4de5a32d service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:20.513750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec029-e9c1-47f1-bf96-7e6b4de5a32d service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:20.514028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec029-e9c1-47f1-bf96-7e6b4de5a32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:20.567344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ec029-e9c1-47f1-bf96-7e6b4de5a32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:20.575209 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ec029-e9c1-47f1-bf96-7e6b4de5a32d service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:20.621521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 743/1472] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:20.686755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652d8f0-051f-4786-a205-d7582db1195a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:20.688734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e652d8f0-051f-4786-a205-d7582db1195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:20.756215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec029-e9c1-47f1-bf96-7e6b4de5a32d service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:20.758631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5a5ec029-e9c1-47f1-bf96-7e6b4de5a32d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:20.945263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec029-e9c1-47f1-bf96-7e6b4de5a32d service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:20.969425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:20.986083 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:20.989824 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:20.991093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:20.991546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] PATH_INFO: `/v3/projects/21454b928e6e405cba3343ac6ab94ac5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:20.994195 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21454b928e6e405cba3343ac6ab94ac5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:20.996413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:21.042162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652d8f0-051f-4786-a205-d7582db1195a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:21.047600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:21.048343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:21.048686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:21.049197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] PATH_INFO: `/v3/users/b94ab8183d2748d9b9d502b262022b05` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:21.052057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94ab8183d2748d9b9d502b262022b05)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:21.054608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:21.143070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21454b928e6e405cba3343ac6ab94ac5', 'request_id': 'req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.170136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21454b928e6e405cba3343ac6ab94ac5', 'request_id': 'req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.194273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21454b928e6e405cba3343ac6ab94ac5', 'request_id': 'req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.194544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94ab8183d2748d9b9d502b262022b05'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.227298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94ab8183d2748d9b9d502b262022b05'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.228236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94ab8183d2748d9b9d502b262022b05'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.239956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] The token cache is being invalidate because project 21454b928e6e405cba3343ac6ab94ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:21.240344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.241759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e19ee23a-d1c6-4a57-a1c3-1e6eb3008299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.271565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 744/1473] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:20 2022] DELETE /identity/v3/projects/21454b928e6e405cba3343ac6ab94ac5 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:21.274783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94ab8183d2748d9b9d502b262022b05'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.281531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff584-63ab-45dd-9dee-ed254d4a6c7d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:21.282939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff584-63ab-45dd-9dee-ed254d4a6c7d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:21.283251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ff584-63ab-45dd-9dee-ed254d4a6c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:21.294216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a0805c98-ff74-4193-a1a3-13cf69c26a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94ab8183d2748d9b9d502b262022b05'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.347212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 730/1474] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:20 2022] DELETE /identity/v3/users/b94ab8183d2748d9b9d502b262022b05 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:21.353282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3514eb-44f3-404f-b9d6-a3ac309af78c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:21.353693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3514eb-44f3-404f-b9d6-a3ac309af78c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:21.354061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3514eb-44f3-404f-b9d6-a3ac309af78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:21.366845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b09ff584-63ab-45dd-9dee-ed254d4a6c7d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:21.368581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b09ff584-63ab-45dd-9dee-ed254d4a6c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:21.436440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ec3514eb-44f3-404f-b9d6-a3ac309af78c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:21.443816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ec3514eb-44f3-404f-b9d6-a3ac309af78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:21.472654 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:21.519359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 745/1475] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:21.520482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ff584-63ab-45dd-9dee-ed254d4a6c7d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:21.524427 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b09ff584-63ab-45dd-9dee-ed254d4a6c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:21.542602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ff584-63ab-45dd-9dee-ed254d4a6c7d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:21.559756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:21.560428 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:21.560711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:21.561059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] PATH_INFO: `/v3/users/f8729c3db0c94b97a2ec7ca31ec420ab` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:21.564430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8729c3db0c94b97a2ec7ca31ec420ab)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:21.570297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:21.638573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 731/1476] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:21.642250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d5016-5c9c-4941-9e65-d1db03c39f04 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:21.642517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d5016-5c9c-4941-9e65-d1db03c39f04 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:21.644424 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d5016-5c9c-4941-9e65-d1db03c39f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:21.712117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8729c3db0c94b97a2ec7ca31ec420ab'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.713769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8729c3db0c94b97a2ec7ca31ec420ab'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.717816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6d1d5016-5c9c-4941-9e65-d1db03c39f04 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:21.723252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6d1d5016-5c9c-4941-9e65-d1db03c39f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:21.746879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8729c3db0c94b97a2ec7ca31ec420ab'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.747795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 732/1477] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:21.748711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8729c3db0c94b97a2ec7ca31ec420ab'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.752946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d5016-5c9c-4941-9e65-d1db03c39f04 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:21.773094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d5016-5c9c-4941-9e65-d1db03c39f04 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:21.780317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8729c3db0c94b97a2ec7ca31ec420ab'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:21.785685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dca160-6716-4f50-be40-40d2d511ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:21.786323 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dca160-6716-4f50-be40-40d2d511ad4e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:21.786595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dca160-6716-4f50-be40-40d2d511ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:21.786861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dca160-6716-4f50-be40-40d2d511ad4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:21.790687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dca160-6716-4f50-be40-40d2d511ad4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:21.791030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dca160-6716-4f50-be40-40d2d511ad4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:21.796618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dca160-6716-4f50-be40-40d2d511ad4e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:21.808672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 746/1478] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:21 2022] DELETE /identity/v3/users/f8729c3db0c94b97a2ec7ca31ec420ab => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:21.809965 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:21.816281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:21.837093 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 733/1479] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:27:21.838934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d81f9-8e5e-4a91-9500-68afb54f24b1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:21.839221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d81f9-8e5e-4a91-9500-68afb54f24b1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:21.839492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d81f9-8e5e-4a91-9500-68afb54f24b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:21.879158 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-663d81f9-8e5e-4a91-9500-68afb54f24b1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:21.880641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-663d81f9-8e5e-4a91-9500-68afb54f24b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:21.955217 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa4479-6d42-4bd6-adeb-92a292daa578 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:21.963131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627ed4e-6c72-4dd3-9748-08c983abebd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:21.963758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ed4e-6c72-4dd3-9748-08c983abebd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:21.964062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ed4e-6c72-4dd3-9748-08c983abebd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:21.964315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ed4e-6c72-4dd3-9748-08c983abebd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:21.968520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9627ed4e-6c72-4dd3-9748-08c983abebd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:22.053619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:22.121667 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 734/1480] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:22.122562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d81f9-8e5e-4a91-9500-68afb54f24b1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:22.126134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-663d81f9-8e5e-4a91-9500-68afb54f24b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:22.151924 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d81f9-8e5e-4a91-9500-68afb54f24b1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:22.157669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0d1f7-dc36-4c2a-b3dc-3e11ed6d0d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:22.158746 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0d1f7-dc36-4c2a-b3dc-3e11ed6d0d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:22.159276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0d1f7-dc36-4c2a-b3dc-3e11ed6d0d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:22.159926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0d1f7-dc36-4c2a-b3dc-3e11ed6d0d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:22.160883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0d1f7-dc36-4c2a-b3dc-3e11ed6d0d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:22.163275 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0d1f7-dc36-4c2a-b3dc-3e11ed6d0d7c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:22.177621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627ed4e-6c72-4dd3-9748-08c983abebd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:22.179095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627ed4e-6c72-4dd3-9748-08c983abebd3 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:22.228136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 747/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:22.271375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 735/1482] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:22 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:22.276679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627ed4e-6c72-4dd3-9748-08c983abebd3 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:22.306193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627ed4e-6c72-4dd3-9748-08c983abebd3 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:22.335970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:22.364702 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0d1f7-dc36-4c2a-b3dc-3e11ed6d0d7c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:22.524954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbb8cb-2327-4269-b427-9c57257aae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:22.526723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbb8cb-2327-4269-b427-9c57257aae80 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:22.528265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbb8cb-2327-4269-b427-9c57257aae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:22.528634 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbb8cb-2327-4269-b427-9c57257aae80 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:22.529886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbb8cb-2327-4269-b427-9c57257aae80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:22.534029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bbb8cb-2327-4269-b427-9c57257aae80 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:22.539722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0d1f7-dc36-4c2a-b3dc-3e11ed6d0d7c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:22.544003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09269c7-96f0-4065-8d83-a26950015b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:22.545060 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09269c7-96f0-4065-8d83-a26950015b00 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:22.545444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09269c7-96f0-4065-8d83-a26950015b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:22.545716 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09269c7-96f0-4065-8d83-a26950015b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:22.580979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09269c7-96f0-4065-8d83-a26950015b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:22.585057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09269c7-96f0-4065-8d83-a26950015b00 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:22.615734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 748/1483] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:22 2022] POST /identity/v3/users => generated 290 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:22.616954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbb8cb-2327-4269-b427-9c57257aae80 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:22.621451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 736/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:22.651836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbb8cb-2327-4269-b427-9c57257aae80 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:22.732064 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68566afe-cf78-4d2e-b3fe-c5ee45a2f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:22.732064 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68566afe-cf78-4d2e-b3fe-c5ee45a2f967 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:22.732064 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68566afe-cf78-4d2e-b3fe-c5ee45a2f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:22.732064 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68566afe-cf78-4d2e-b3fe-c5ee45a2f967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:22.732608 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68566afe-cf78-4d2e-b3fe-c5ee45a2f967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:22.738400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68566afe-cf78-4d2e-b3fe-c5ee45a2f967 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:22.793265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 749/1485] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:22.794167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09269c7-96f0-4065-8d83-a26950015b00 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:22.815459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09269c7-96f0-4065-8d83-a26950015b00 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:22.833665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5db1-4c98-4cdd-a917-bcee5b4544b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:22.834889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5db1-4c98-4cdd-a917-bcee5b4544b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:22.835170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5db1-4c98-4cdd-a917-bcee5b4544b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:22.835447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5db1-4c98-4cdd-a917-bcee5b4544b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:22.841660 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f5db1-4c98-4cdd-a917-bcee5b4544b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:22.843290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f5db1-4c98-4cdd-a917-bcee5b4544b4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:22.873603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 737/1486] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:22.873828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68566afe-cf78-4d2e-b3fe-c5ee45a2f967 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:22.897003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68566afe-cf78-4d2e-b3fe-c5ee45a2f967 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:22.918713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7609267-da47-4bf5-8192-bb5f21094b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:22.920294 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7609267-da47-4bf5-8192-bb5f21094b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:22.920587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7609267-da47-4bf5-8192-bb5f21094b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:22.920867 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7609267-da47-4bf5-8192-bb5f21094b3d admin admin] PATH_INFO: `/v3/projects/4d09850e886c45cabe094d9b89f1b54b/users/e490c480ccb84cd19021418735729cf9/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:22.956226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7609267-da47-4bf5-8192-bb5f21094b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d09850e886c45cabe094d9b89f1b54b, user_id=e490c480ccb84cd19021418735729cf9, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:22.960241 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7609267-da47-4bf5-8192-bb5f21094b3d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:22.993879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 750/1487] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:22 2022] PUT /identity/v3/projects/4d09850e886c45cabe094d9b89f1b54b/users/e490c480ccb84cd19021418735729cf9/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:23.007455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2777c34-4435-4299-93f5-fa71b3805f1f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:23.007768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2777c34-4435-4299-93f5-fa71b3805f1f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:23.007945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2777c34-4435-4299-93f5-fa71b3805f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:23.079255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f2777c34-4435-4299-93f5-fa71b3805f1f None None] MFA Rules not processed for user `e490c480ccb84cd19021418735729cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:23.082517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f2777c34-4435-4299-93f5-fa71b3805f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:23.234314 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 738/1488] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:23.239573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7609267-da47-4bf5-8192-bb5f21094b3d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:23.335169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7609267-da47-4bf5-8192-bb5f21094b3d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:23.343536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c4ab9-13b1-49af-86ee-5da4cebaa1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:23.345516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c4ab9-13b1-49af-86ee-5da4cebaa1fc admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:23.345516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c4ab9-13b1-49af-86ee-5da4cebaa1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:23.346046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c4ab9-13b1-49af-86ee-5da4cebaa1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:23.348772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c4ab9-13b1-49af-86ee-5da4cebaa1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:23.352008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c4ab9-13b1-49af-86ee-5da4cebaa1fc admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:23.405133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 751/1489] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:23 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:23.411488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2777c34-4435-4299-93f5-fa71b3805f1f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:23.433477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2777c34-4435-4299-93f5-fa71b3805f1f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:23.506653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:23.526039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98b887-16ef-4938-b9fd-a8440c698d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:23.527540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b887-16ef-4938-b9fd-a8440c698d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:23.528110 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b887-16ef-4938-b9fd-a8440c698d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:23.528628 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b887-16ef-4938-b9fd-a8440c698d04 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:23.529441 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98b887-16ef-4938-b9fd-a8440c698d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:23.531667 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98b887-16ef-4938-b9fd-a8440c698d04 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:23.582382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 739/1490] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:23 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:23.584036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c4ab9-13b1-49af-86ee-5da4cebaa1fc admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:23.631705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c4ab9-13b1-49af-86ee-5da4cebaa1fc admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:23.647605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6438213-15b1-4db3-be35-d88da44fb294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:23.650390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438213-15b1-4db3-be35-d88da44fb294 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:23.652347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438213-15b1-4db3-be35-d88da44fb294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:23.652759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6438213-15b1-4db3-be35-d88da44fb294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:23.667150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6438213-15b1-4db3-be35-d88da44fb294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:23.672765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6438213-15b1-4db3-be35-d88da44fb294 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:23.711877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98b887-16ef-4938-b9fd-a8440c698d04 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:23.712615 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 752/1491] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:23.761918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98b887-16ef-4938-b9fd-a8440c698d04 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:23.793654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67254a-ca44-4d1b-8315-e4f0a0edcbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:23.794241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67254a-ca44-4d1b-8315-e4f0a0edcbdb admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:23.794640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67254a-ca44-4d1b-8315-e4f0a0edcbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:23.794813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67254a-ca44-4d1b-8315-e4f0a0edcbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:23.795429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67254a-ca44-4d1b-8315-e4f0a0edcbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:23.797071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67254a-ca44-4d1b-8315-e4f0a0edcbdb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:23.870861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 740/1492] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:23.875271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6438213-15b1-4db3-be35-d88da44fb294 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:23.890755 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6438213-15b1-4db3-be35-d88da44fb294 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:23.898779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e4f3c-886c-456a-8a58-ac7782dd082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:23.900225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e4f3c-886c-456a-8a58-ac7782dd082f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:23.900818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e4f3c-886c-456a-8a58-ac7782dd082f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:23.901353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e4f3c-886c-456a-8a58-ac7782dd082f admin admin] PATH_INFO: `/v3/projects/0f3e51cb73ca44fd89c2c295538796b2/users/e29acb35283a4e5d90bcf56e25d0c8e2/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:23.925057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e4f3c-886c-456a-8a58-ac7782dd082f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3e51cb73ca44fd89c2c295538796b2, user_id=e29acb35283a4e5d90bcf56e25d0c8e2, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:23.928556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e4f3c-886c-456a-8a58-ac7782dd082f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:23.951138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 753/1493] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:23 2022] PUT /identity/v3/projects/0f3e51cb73ca44fd89c2c295538796b2/users/e29acb35283a4e5d90bcf56e25d0c8e2/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:23.964756 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aac1c-b0f7-4c66-89bb-a4291140118b None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:23.965053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aac1c-b0f7-4c66-89bb-a4291140118b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:23.965952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aac1c-b0f7-4c66-89bb-a4291140118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:24.079020 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d13aac1c-b0f7-4c66-89bb-a4291140118b None None] MFA Rules not processed for user `e29acb35283a4e5d90bcf56e25d0c8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:24.079165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e4f3c-886c-456a-8a58-ac7782dd082f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:24.080695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d13aac1c-b0f7-4c66-89bb-a4291140118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:24.082114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-465e4f3c-886c-456a-8a58-ac7782dd082f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:24.142545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:24.260956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e4f3c-886c-456a-8a58-ac7782dd082f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:24.279283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:24.281153 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:24.282886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:24.285395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] PATH_INFO: `/v3/projects/835af284442045d59595416a598ff681` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:24.289991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=835af284442045d59595416a598ff681)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:24.298706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:24.391344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 741/1494] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:24.399752 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aac1c-b0f7-4c66-89bb-a4291140118b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:24.433615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aac1c-b0f7-4c66-89bb-a4291140118b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:24.433869 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835af284442045d59595416a598ff681', 'request_id': 'req-ede2645f-c114-41c2-b5fc-86f2f1c81a24'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:24.465561 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835af284442045d59595416a598ff681', 'request_id': 'req-ede2645f-c114-41c2-b5fc-86f2f1c81a24'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:24.494731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835af284442045d59595416a598ff681', 'request_id': 'req-ede2645f-c114-41c2-b5fc-86f2f1c81a24'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:24.536320 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] The token cache is being invalidate because project 835af284442045d59595416a598ff681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:24.538048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:24.540444 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:24.550427 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 754/1495] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:24 2022] DELETE /identity/v3/projects/835af284442045d59595416a598ff681 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:24.555285 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:24.558788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:24.724752 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662322a1-0527-47b7-82e6-ac267a6a4ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:24.725458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662322a1-0527-47b7-82e6-ac267a6a4ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:24.725729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662322a1-0527-47b7-82e6-ac267a6a4ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:24.725995 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662322a1-0527-47b7-82e6-ac267a6a4ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:24.727208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662322a1-0527-47b7-82e6-ac267a6a4ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:24.733665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662322a1-0527-47b7-82e6-ac267a6a4ac3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:24.796925 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 742/1496] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:24 2022] POST /identity/v3/projects => generated 377 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:24.802294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662322a1-0527-47b7-82e6-ac267a6a4ac3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:24.804228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-662322a1-0527-47b7-82e6-ac267a6a4ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:24.824867 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2645f-c114-41c2-b5fc-86f2f1c81a24 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:24.895918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:24.942240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662322a1-0527-47b7-82e6-ac267a6a4ac3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:24.955151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38920f9a-5a67-465c-b115-62ce955b82e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:24.955659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38920f9a-5a67-465c-b115-62ce955b82e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:24.955934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38920f9a-5a67-465c-b115-62ce955b82e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:24.956238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38920f9a-5a67-465c-b115-62ce955b82e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:24.956918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38920f9a-5a67-465c-b115-62ce955b82e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:24.958930 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38920f9a-5a67-465c-b115-62ce955b82e5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:25.006771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:25.037286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 743/1497] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:24 2022] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:25.052632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:25.053324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:25.053595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:25.053871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] PATH_INFO: `/v3/users/33de5513fa974699aa8064a94ee7c73e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:25.058120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33de5513fa974699aa8064a94ee7c73e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:25.060112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:25.061374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38920f9a-5a67-465c-b115-62ce955b82e5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:25.109690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38920f9a-5a67-465c-b115-62ce955b82e5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:25.131136 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e67329-0812-4174-9c30-d2a71fdf2d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:25.131851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67329-0812-4174-9c30-d2a71fdf2d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:25.132128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67329-0812-4174-9c30-d2a71fdf2d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:25.132397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67329-0812-4174-9c30-d2a71fdf2d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:25.133072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e67329-0812-4174-9c30-d2a71fdf2d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:25.134806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e67329-0812-4174-9c30-d2a71fdf2d99 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:25.162358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 744/1498] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:27:25.170615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e67329-0812-4174-9c30-d2a71fdf2d99 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:25.188369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e67329-0812-4174-9c30-d2a71fdf2d99 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:25.201961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1928f5-861d-4756-9a71-6448ba161869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:25.203341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1928f5-861d-4756-9a71-6448ba161869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:25.205309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1928f5-861d-4756-9a71-6448ba161869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:25.205989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1928f5-861d-4756-9a71-6448ba161869 admin admin] PATH_INFO: `/v3/projects/a386535a4e354b5f888ed0366c62e490/users/d9ccbb128d5543e5a83c2ce3f138a50d/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:25.211248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33de5513fa974699aa8064a94ee7c73e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:25.218173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33de5513fa974699aa8064a94ee7c73e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:25.228182 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1928f5-861d-4756-9a71-6448ba161869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a386535a4e354b5f888ed0366c62e490, user_id=d9ccbb128d5543e5a83c2ce3f138a50d, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:25.233236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1928f5-861d-4756-9a71-6448ba161869 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:25.254676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33de5513fa974699aa8064a94ee7c73e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:25.255408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33de5513fa974699aa8064a94ee7c73e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:25.260370 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 745/1499] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:25 2022] PUT /identity/v3/projects/a386535a4e354b5f888ed0366c62e490/users/d9ccbb128d5543e5a83c2ce3f138a50d/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:25.264235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1928f5-861d-4756-9a71-6448ba161869 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:25.267614 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8f1928f5-861d-4756-9a71-6448ba161869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:25.284021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33de5513fa974699aa8064a94ee7c73e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:25.306212 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 755/1500] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:24 2022] DELETE /identity/v3/users/33de5513fa974699aa8064a94ee7c73e => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:25.455446 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1928f5-861d-4756-9a71-6448ba161869 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:25.508892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:25.510640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:25.734383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fb68c-c25b-47ae-a471-41ce77aa7c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:25.735321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fb68c-c25b-47ae-a471-41ce77aa7c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:25.736604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fb68c-c25b-47ae-a471-41ce77aa7c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:25.739088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fb68c-c25b-47ae-a471-41ce77aa7c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:25.740123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fb68c-c25b-47ae-a471-41ce77aa7c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:25.744163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fb68c-c25b-47ae-a471-41ce77aa7c8b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:25.781632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f8fcd-586a-4334-8bd5-ababeed7ad75 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:25.792230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 746/1501] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:27:25.794374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fb68c-c25b-47ae-a471-41ce77aa7c8b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:25.806487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:25.807835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:25.808896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:25.810046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] PATH_INFO: `/v3/projects/7b273e3e12024962a5ce62a448c03e7a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:25.817302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fb68c-c25b-47ae-a471-41ce77aa7c8b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:25.818698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b273e3e12024962a5ce62a448c03e7a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:25.822013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:25.825223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0392f4f-2b88-4f64-a246-00a25069c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:25.826082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0392f4f-2b88-4f64-a246-00a25069c720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:25.826503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0392f4f-2b88-4f64-a246-00a25069c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:25.826917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0392f4f-2b88-4f64-a246-00a25069c720 admin admin] PATH_INFO: `/v3/projects/a386535a4e354b5f888ed0366c62e490/users/d9ccbb128d5543e5a83c2ce3f138a50d/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:25.829188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0392f4f-2b88-4f64-a246-00a25069c720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a386535a4e354b5f888ed0366c62e490, user_id=d9ccbb128d5543e5a83c2ce3f138a50d, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:25.846592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0392f4f-2b88-4f64-a246-00a25069c720 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:25.870371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 747/1502] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:25 2022] PUT /identity/v3/projects/a386535a4e354b5f888ed0366c62e490/users/d9ccbb128d5543e5a83c2ce3f138a50d/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:25.886920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b09739-b238-4e07-af0b-c0f20c354569 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:25.886920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b09739-b238-4e07-af0b-c0f20c354569 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:25.886920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b09739-b238-4e07-af0b-c0f20c354569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:25.957124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b273e3e12024962a5ce62a448c03e7a', 'request_id': 'req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:25.959427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-24b09739-b238-4e07-af0b-c0f20c354569 None None] MFA Rules not processed for user `d9ccbb128d5543e5a83c2ce3f138a50d`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:25.960670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-24b09739-b238-4e07-af0b-c0f20c354569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:25.984123 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b273e3e12024962a5ce62a448c03e7a', 'request_id': 'req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:26.003535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b273e3e12024962a5ce62a448c03e7a', 'request_id': 'req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:26.028078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:26.060222 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] The token cache is being invalidate because project 7b273e3e12024962a5ce62a448c03e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:26.061403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:26.062722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:26.085929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 756/1503] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:25 2022] DELETE /identity/v3/projects/7b273e3e12024962a5ce62a448c03e7a => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:26.086952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:26.092180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:26.105725 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:26.222163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b301ed-2c5b-4de1-9ab9-65ced3cc0834 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:26.240534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 748/1504] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:26.253826 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:26.254460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:26.254460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:26.254460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] PATH_INFO: `/v3/users/fabe79463fae444ead8315d2b61fed84` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:26.254460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fabe79463fae444ead8315d2b61fed84)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:26.266192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b09739-b238-4e07-af0b-c0f20c354569 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:26.268238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-24b09739-b238-4e07-af0b-c0f20c354569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:26.272337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:26.405290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b09739-b238-4e07-af0b-c0f20c354569 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:26.417848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1315cd7-bd11-4b0b-8f8c-b6ac5c7c0761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:26.418809 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1315cd7-bd11-4b0b-8f8c-b6ac5c7c0761 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:26.419289 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1315cd7-bd11-4b0b-8f8c-b6ac5c7c0761 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:26.419800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1315cd7-bd11-4b0b-8f8c-b6ac5c7c0761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:26.429384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fabe79463fae444ead8315d2b61fed84'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:26.430294 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fabe79463fae444ead8315d2b61fed84'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:26.448296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1315cd7-bd11-4b0b-8f8c-b6ac5c7c0761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:26.463131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fabe79463fae444ead8315d2b61fed84'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:26.463505 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1315cd7-bd11-4b0b-8f8c-b6ac5c7c0761 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:26.464722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fabe79463fae444ead8315d2b61fed84'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:26.511848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 749/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:26.520338 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb96202b-79a0-4ba5-9c45-cc9dd8123fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fabe79463fae444ead8315d2b61fed84'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:26.560356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 757/1506] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:26 2022] DELETE /identity/v3/users/fabe79463fae444ead8315d2b61fed84 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:26.652793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1315cd7-bd11-4b0b-8f8c-b6ac5c7c0761 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:26.654541 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b1315cd7-bd11-4b0b-8f8c-b6ac5c7c0761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:26.679616 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1315cd7-bd11-4b0b-8f8c-b6ac5c7c0761 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:26.800163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d21747-21ac-4948-9be3-d0568675efb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:26.801254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d21747-21ac-4948-9be3-d0568675efb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:26.801588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d21747-21ac-4948-9be3-d0568675efb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:26.801865 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d21747-21ac-4948-9be3-d0568675efb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:26.804442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d7d21747-21ac-4948-9be3-d0568675efb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:26.970928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d21747-21ac-4948-9be3-d0568675efb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:26.973799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d21747-21ac-4948-9be3-d0568675efb1 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:26.989121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 750/1507] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:28.815460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674d31a-5c9f-4177-8cb3-e27b52f0b3f7 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:28.816635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674d31a-5c9f-4177-8cb3-e27b52f0b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:28.817116 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674d31a-5c9f-4177-8cb3-e27b52f0b3f7 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:28.818727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 758/1508] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:27:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:27:28.988126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc76d2-3b90-4858-b8b4-cb055f2f07d4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:28.988653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc76d2-3b90-4858-b8b4-cb055f2f07d4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:28.988738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc76d2-3b90-4858-b8b4-cb055f2f07d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:29.057549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-58cc76d2-3b90-4858-b8b4-cb055f2f07d4 None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:29.058924 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-58cc76d2-3b90-4858-b8b4-cb055f2f07d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:29.082292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:29.263768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674d31a-5c9f-4177-8cb3-e27b52f0b3f7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:29.265247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0674d31a-5c9f-4177-8cb3-e27b52f0b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:29.266576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 751/1509] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:27:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:29.460459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674d31a-5c9f-4177-8cb3-e27b52f0b3f7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:29.466186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:29.466841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:29.476296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:29.478511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] PATH_INFO: `/v3/projects/5cce0aa2fb4142af805d923606bd5aba` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:29.480202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cce0aa2fb4142af805d923606bd5aba)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:29.482500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:29.571470 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:29.584276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc76d2-3b90-4858-b8b4-cb055f2f07d4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:29.588201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-58cc76d2-3b90-4858-b8b4-cb055f2f07d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:29.637706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc76d2-3b90-4858-b8b4-cb055f2f07d4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:29.672415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cce0aa2fb4142af805d923606bd5aba', 'request_id': 'req-1841a580-d2cc-4a12-965b-0e8daa83f1ed'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:29.686914 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cce0aa2fb4142af805d923606bd5aba', 'request_id': 'req-1841a580-d2cc-4a12-965b-0e8daa83f1ed'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:29.710197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cce0aa2fb4142af805d923606bd5aba', 'request_id': 'req-1841a580-d2cc-4a12-965b-0e8daa83f1ed'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:29.748314 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] The token cache is being invalidate because project 5cce0aa2fb4142af805d923606bd5aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:29.750394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:29.752342 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1841a580-d2cc-4a12-965b-0e8daa83f1ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:29.760144 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 759/1510] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:29 2022] DELETE /identity/v3/projects/5cce0aa2fb4142af805d923606bd5aba => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:29.763262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512bd3-79ee-4e7d-bccb-854099998aa9 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:29.764902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512bd3-79ee-4e7d-bccb-854099998aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:29.765731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512bd3-79ee-4e7d-bccb-854099998aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:29.840795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-44512bd3-79ee-4e7d-bccb-854099998aa9 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:29.849127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-44512bd3-79ee-4e7d-bccb-854099998aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:29.872894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:29.875696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:29.876491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:29.878571 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] PATH_INFO: `/v3/projects/dae5628bdb044b6e8c580e6783d60bb4` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:29.882140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae5628bdb044b6e8c580e6783d60bb4)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:29.888931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:30.022194 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae5628bdb044b6e8c580e6783d60bb4', 'request_id': 'req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:30.047079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 760/1511] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:30.052164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512bd3-79ee-4e7d-bccb-854099998aa9 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:30.053745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae5628bdb044b6e8c580e6783d60bb4', 'request_id': 'req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:30.058621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-44512bd3-79ee-4e7d-bccb-854099998aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:30.077459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae5628bdb044b6e8c580e6783d60bb4', 'request_id': 'req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:30.120069 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] The token cache is being invalidate because project dae5628bdb044b6e8c580e6783d60bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:30.120928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:30.123103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-45ade04d-ac96-4b00-b5f6-0de1740f5b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:30.133790 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 752/1512] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:29 2022] DELETE /identity/v3/projects/dae5628bdb044b6e8c580e6783d60bb4 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:30.136836 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f016163-00df-4493-985f-cd5255e101ff None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.139680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f016163-00df-4493-985f-cd5255e101ff None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.139977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f016163-00df-4493-985f-cd5255e101ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.180113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4f016163-00df-4493-985f-cd5255e101ff None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:30.181427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4f016163-00df-4493-985f-cd5255e101ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:30.244537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:30.306480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512bd3-79ee-4e7d-bccb-854099998aa9 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:30.334315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 753/1513] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:30.336548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bc398-7e2d-40da-8cb9-aabf2b8de99a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.336838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bc398-7e2d-40da-8cb9-aabf2b8de99a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.337312 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bc398-7e2d-40da-8cb9-aabf2b8de99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.378260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7a4bc398-7e2d-40da-8cb9-aabf2b8de99a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:30.380584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7a4bc398-7e2d-40da-8cb9-aabf2b8de99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:30.389805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:30.404206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 754/1514] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:30.404206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bc398-7e2d-40da-8cb9-aabf2b8de99a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:30.422187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bc398-7e2d-40da-8cb9-aabf2b8de99a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:30.429658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756eb888-6c70-47fc-95f9-02d3476a9274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:30.430762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eb888-6c70-47fc-95f9-02d3476a9274 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.431736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eb888-6c70-47fc-95f9-02d3476a9274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.432220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756eb888-6c70-47fc-95f9-02d3476a9274 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.433099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756eb888-6c70-47fc-95f9-02d3476a9274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:30.433613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756eb888-6c70-47fc-95f9-02d3476a9274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:30.435183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f26cf-3753-4ccf-ae54-62513a097eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:30.435815 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f26cf-3753-4ccf-ae54-62513a097eca service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.436096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f26cf-3753-4ccf-ae54-62513a097eca service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.436206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756eb888-6c70-47fc-95f9-02d3476a9274 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:30.437170 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f26cf-3753-4ccf-ae54-62513a097eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.441635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d60f26cf-3753-4ccf-ae54-62513a097eca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:30.455635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 755/1515] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:30.457997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664152-6160-4464-baab-7742686d62ba None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.458527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664152-6160-4464-baab-7742686d62ba None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.458867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36664152-6160-4464-baab-7742686d62ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.461530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f26cf-3753-4ccf-ae54-62513a097eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:30.463417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f26cf-3753-4ccf-ae54-62513a097eca service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:30.479459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 761/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:30.480630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f26cf-3753-4ccf-ae54-62513a097eca service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:30.492856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f26cf-3753-4ccf-ae54-62513a097eca service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:30.500098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-36664152-6160-4464-baab-7742686d62ba None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:30.501044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74befbf6-204d-4e7b-acdb-128efcc8d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:30.501686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74befbf6-204d-4e7b-acdb-128efcc8d30f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.506591 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74befbf6-204d-4e7b-acdb-128efcc8d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.506978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74befbf6-204d-4e7b-acdb-128efcc8d30f admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.507225 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-36664152-6160-4464-baab-7742686d62ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:30.508625 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74befbf6-204d-4e7b-acdb-128efcc8d30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:30.511158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74befbf6-204d-4e7b-acdb-128efcc8d30f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:30.537254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 756/1517] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:30.538440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664152-6160-4464-baab-7742686d62ba None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:30.558349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36664152-6160-4464-baab-7742686d62ba None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:30.571587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 762/1518] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:30 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:30.575785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74befbf6-204d-4e7b-acdb-128efcc8d30f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:30.576894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca44b03-4ea8-4756-9dd9-e7760219de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:30.577850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca44b03-4ea8-4756-9dd9-e7760219de90 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.578297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca44b03-4ea8-4756-9dd9-e7760219de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.578794 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca44b03-4ea8-4756-9dd9-e7760219de90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.580043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca44b03-4ea8-4756-9dd9-e7760219de90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:30.580463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca44b03-4ea8-4756-9dd9-e7760219de90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:30.586014 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca44b03-4ea8-4756-9dd9-e7760219de90 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:30.620062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 757/1519] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:30.625643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca44b03-4ea8-4756-9dd9-e7760219de90 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:30.665320 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca44b03-4ea8-4756-9dd9-e7760219de90 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:30.739405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74befbf6-204d-4e7b-acdb-128efcc8d30f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:30.747111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024b706-01e9-4986-8b11-704fd02a3edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:30.747802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b706-01e9-4986-8b11-704fd02a3edd admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.748178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b706-01e9-4986-8b11-704fd02a3edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.748515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024b706-01e9-4986-8b11-704fd02a3edd admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.749276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024b706-01e9-4986-8b11-704fd02a3edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:30.751433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024b706-01e9-4986-8b11-704fd02a3edd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:30.782013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a121a89-14c1-438f-8889-96ab3db29fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:30.783901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121a89-14c1-438f-8889-96ab3db29fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.787466 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121a89-14c1-438f-8889-96ab3db29fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.789095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121a89-14c1-438f-8889-96ab3db29fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.790099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a121a89-14c1-438f-8889-96ab3db29fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:30.792435 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a121a89-14c1-438f-8889-96ab3db29fb3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:30.797941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 763/1520] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:30 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:27:30.799449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024b706-01e9-4986-8b11-704fd02a3edd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:30.811956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024b706-01e9-4986-8b11-704fd02a3edd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:30.820204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61c83d-f618-4735-94c4-6a649e77fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:30.821421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61c83d-f618-4735-94c4-6a649e77fb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.821889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61c83d-f618-4735-94c4-6a649e77fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.822211 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61c83d-f618-4735-94c4-6a649e77fb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.823040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61c83d-f618-4735-94c4-6a649e77fb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:30.825277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61c83d-f618-4735-94c4-6a649e77fb33 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:30.846739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 764/1522] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:30.848334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61c83d-f618-4735-94c4-6a649e77fb33 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:30.850778 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 758/1522] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:30 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:30.852394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a121a89-14c1-438f-8889-96ab3db29fb3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:30.864548 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61c83d-f618-4735-94c4-6a649e77fb33 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:30.947376 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a121a89-14c1-438f-8889-96ab3db29fb3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:30.952038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565ed9f-2b50-4547-a757-1608b9b0e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:30.952667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ed9f-2b50-4547-a757-1608b9b0e02e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.952936 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ed9f-2b50-4547-a757-1608b9b0e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.953252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ed9f-2b50-4547-a757-1608b9b0e02e admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.953890 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565ed9f-2b50-4547-a757-1608b9b0e02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:30.955135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd13cc2-79c1-4a25-8090-f9367514719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:30.955447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565ed9f-2b50-4547-a757-1608b9b0e02e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:30.956435 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd13cc2-79c1-4a25-8090-f9367514719e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.957364 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd13cc2-79c1-4a25-8090-f9367514719e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.958666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd13cc2-79c1-4a25-8090-f9367514719e admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.959924 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd13cc2-79c1-4a25-8090-f9367514719e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:30.963497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd13cc2-79c1-4a25-8090-f9367514719e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:30.967251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 765/1523] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:30.973472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf9127-2a02-4989-bdce-453c68d0baec None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:30.973768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf9127-2a02-4989-bdce-453c68d0baec None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:30.974089 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf9127-2a02-4989-bdce-453c68d0baec None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:30.976605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 766/1524] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:27:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:27:30.977844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf9127-2a02-4989-bdce-453c68d0baec None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:30.998373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf9127-2a02-4989-bdce-453c68d0baec None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:31.006871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 759/1525] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:30 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:31.008289 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd13cc2-79c1-4a25-8090-f9367514719e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:31.010752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859a668-2215-4398-8ef7-8868df879ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:31.014054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859a668-2215-4398-8ef7-8868df879ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:31.014645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859a668-2215-4398-8ef7-8868df879ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:31.015437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859a668-2215-4398-8ef7-8868df879ff2 admin admin] PATH_INFO: `/v3/projects/a368158fe7c240609876084630be3caa/users/338720f71df14aa5ad8c480d078ab8be/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:31.021646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd13cc2-79c1-4a25-8090-f9367514719e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:31.028266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567c6b-aeb6-40c3-bfd8-052b724700c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:31.028901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567c6b-aeb6-40c3-bfd8-052b724700c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:31.028901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567c6b-aeb6-40c3-bfd8-052b724700c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:31.029076 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567c6b-aeb6-40c3-bfd8-052b724700c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:31.030171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567c6b-aeb6-40c3-bfd8-052b724700c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:31.031851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567c6b-aeb6-40c3-bfd8-052b724700c7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:31.045963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:31.056655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 760/1526] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:27:31.056655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf7247-2170-42a0-9c73-b3611779c336 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:31.056655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf7247-2170-42a0-9c73-b3611779c336 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:31.056952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf7247-2170-42a0-9c73-b3611779c336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:31.058763 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859a668-2215-4398-8ef7-8868df879ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a368158fe7c240609876084630be3caa, user_id=338720f71df14aa5ad8c480d078ab8be, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:31.069087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859a668-2215-4398-8ef7-8868df879ff2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:31.088667 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-25cf7247-2170-42a0-9c73-b3611779c336 None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:31.090496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-25cf7247-2170-42a0-9c73-b3611779c336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:31.125091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 767/1527] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:30 2022] PUT /identity/v3/projects/a368158fe7c240609876084630be3caa/users/338720f71df14aa5ad8c480d078ab8be/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:31.125091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859a668-2215-4398-8ef7-8868df879ff2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:31.140163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:31.266163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859a668-2215-4398-8ef7-8868df879ff2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:31.271702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c624d7a-fbfe-4fe3-abb9-3dc6967ebf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:31.272676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c624d7a-fbfe-4fe3-abb9-3dc6967ebf15 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:31.276122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 761/1528] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:31.276286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c624d7a-fbfe-4fe3-abb9-3dc6967ebf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:31.276688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c624d7a-fbfe-4fe3-abb9-3dc6967ebf15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:31.277479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c624d7a-fbfe-4fe3-abb9-3dc6967ebf15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:31.279388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6e22d-b59f-4a6e-aea4-f0d65ccb57fa None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:31.279510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c624d7a-fbfe-4fe3-abb9-3dc6967ebf15 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:31.281260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6e22d-b59f-4a6e-aea4-f0d65ccb57fa None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:31.281552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6e22d-b59f-4a6e-aea4-f0d65ccb57fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:31.294735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 768/1529] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:31.295765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c624d7a-fbfe-4fe3-abb9-3dc6967ebf15 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:31.298972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2c624d7a-fbfe-4fe3-abb9-3dc6967ebf15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:31.332142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c624d7a-fbfe-4fe3-abb9-3dc6967ebf15 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:31.341041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:31.341701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:31.341977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:31.342244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] PATH_INFO: `/v3/users/e490c480ccb84cd19021418735729cf9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:31.347902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e490c480ccb84cd19021418735729cf9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:31.349898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:31.448416 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e490c480ccb84cd19021418735729cf9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:31.449154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e490c480ccb84cd19021418735729cf9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:31.465862 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e490c480ccb84cd19021418735729cf9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:31.466642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e490c480ccb84cd19021418735729cf9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:31.495393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e490c480ccb84cd19021418735729cf9'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:31.531641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 769/1530] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:31 2022] DELETE /identity/v3/users/e490c480ccb84cd19021418735729cf9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:31.537122 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:31.542399 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:31.546009 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f5e6e22d-b59f-4a6e-aea4-f0d65ccb57fa None None] MFA Rules not processed for user `338720f71df14aa5ad8c480d078ab8be`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:31.548340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f5e6e22d-b59f-4a6e-aea4-f0d65ccb57fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:31.701320 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4ee6d-9fad-4827-adf7-2a8eca8fdcb1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:31.729887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 762/1531] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:31.729887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206250b-6e49-4b4d-b525-c25b4a265705 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:31.729887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206250b-6e49-4b4d-b525-c25b4a265705 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:31.729887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206250b-6e49-4b4d-b525-c25b4a265705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:31.733074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ce91-3797-460e-9527-cd05d028b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:31.735337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ce91-3797-460e-9527-cd05d028b354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:31.735792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ce91-3797-460e-9527-cd05d028b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:31.737380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ce91-3797-460e-9527-cd05d028b354 admin admin] PATH_INFO: `/v3/projects/039416be4a644cefb100a0b572fbb166/users/0b09f32458f44614b2b5c8679d3419a5/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:31.805149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39ce91-3797-460e-9527-cd05d028b354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039416be4a644cefb100a0b572fbb166, user_id=0b09f32458f44614b2b5c8679d3419a5, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:31.807822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39ce91-3797-460e-9527-cd05d028b354 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:31.810145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c206250b-6e49-4b4d-b525-c25b4a265705 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:31.811230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c206250b-6e49-4b4d-b525-c25b4a265705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:31.815400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:31.826417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 763/1532] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:31.827629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206250b-6e49-4b4d-b525-c25b4a265705 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:31.840826 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 770/1533] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:31 2022] PUT /identity/v3/projects/039416be4a644cefb100a0b572fbb166/users/0b09f32458f44614b2b5c8679d3419a5/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:31.841818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ce91-3797-460e-9527-cd05d028b354 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:31.842986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c206250b-6e49-4b4d-b525-c25b4a265705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:31.853568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1e39ce91-3797-460e-9527-cd05d028b354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:32.043853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ce91-3797-460e-9527-cd05d028b354 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:32.050201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af3b15-9572-4584-969f-36fb820054d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:32.051842 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af3b15-9572-4584-969f-36fb820054d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.052331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af3b15-9572-4584-969f-36fb820054d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.053130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af3b15-9572-4584-969f-36fb820054d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.053939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af3b15-9572-4584-969f-36fb820054d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:32.056179 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af3b15-9572-4584-969f-36fb820054d8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:32.057727 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206250b-6e49-4b4d-b525-c25b4a265705 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:32.076428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:32.098897 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 771/1534] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:31 2022] POST /identity/v3/projects => generated 383 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:32.100262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d158-5afb-4275-a13f-d10ed3519cd7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.101304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d158-5afb-4275-a13f-d10ed3519cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.101765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d158-5afb-4275-a13f-d10ed3519cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.166105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f2a0d158-5afb-4275-a13f-d10ed3519cd7 None None] MFA Rules not processed for user `0b09f32458f44614b2b5c8679d3419a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:32.168038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f2a0d158-5afb-4275-a13f-d10ed3519cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:32.181645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c96c23-efa4-4695-9083-3cbb1e0137b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:32.182651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96c23-efa4-4695-9083-3cbb1e0137b0 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.182975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96c23-efa4-4695-9083-3cbb1e0137b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.183548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96c23-efa4-4695-9083-3cbb1e0137b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.185816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-32c96c23-efa4-4695-9083-3cbb1e0137b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:32.206294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c96c23-efa4-4695-9083-3cbb1e0137b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:32.209094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c96c23-efa4-4695-9083-3cbb1e0137b0 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:32.250716 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 764/1535] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:32.251949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c96c23-efa4-4695-9083-3cbb1e0137b0 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:32.256796 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-32c96c23-efa4-4695-9083-3cbb1e0137b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:32.275562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 772/1536] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:32.276635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0d158-5afb-4275-a13f-d10ed3519cd7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:32.392826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c96c23-efa4-4695-9083-3cbb1e0137b0 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:32.429206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0d158-5afb-4275-a13f-d10ed3519cd7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:32.452406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f79e55-7456-4a3a-9700-23205638e024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:32.452623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79e55-7456-4a3a-9700-23205638e024 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.452901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79e55-7456-4a3a-9700-23205638e024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.453564 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79e55-7456-4a3a-9700-23205638e024 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.453826 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f79e55-7456-4a3a-9700-23205638e024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:32.455767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f79e55-7456-4a3a-9700-23205638e024 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:32.487957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:32.499586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 773/1537] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:32 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:32.499586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f79e55-7456-4a3a-9700-23205638e024 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:32.505675 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f1b42-bce2-47ae-9fcc-ea41e7059dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:32.506529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1b42-bce2-47ae-9fcc-ea41e7059dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.507089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1b42-bce2-47ae-9fcc-ea41e7059dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.507502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1b42-bce2-47ae-9fcc-ea41e7059dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.524507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f1b42-bce2-47ae-9fcc-ea41e7059dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:32.526499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f1b42-bce2-47ae-9fcc-ea41e7059dd0 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:32.533792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f79e55-7456-4a3a-9700-23205638e024 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:32.541954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 765/1538] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:32.543427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f1b42-bce2-47ae-9fcc-ea41e7059dd0 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:32.547352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebd9da-897b-469e-a287-bac8d5b345b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:32.548522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebd9da-897b-469e-a287-bac8d5b345b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.548795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebd9da-897b-469e-a287-bac8d5b345b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.549162 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebd9da-897b-469e-a287-bac8d5b345b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.550208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebd9da-897b-469e-a287-bac8d5b345b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:32.554185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebd9da-897b-469e-a287-bac8d5b345b3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:32.556672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f1b42-bce2-47ae-9fcc-ea41e7059dd0 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:32.562477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e21f61-bba2-42b8-b569-4396c1b24ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:32.564684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e21f61-bba2-42b8-b569-4396c1b24ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.565277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e21f61-bba2-42b8-b569-4396c1b24ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.565841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e21f61-bba2-42b8-b569-4396c1b24ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.566958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e21f61-bba2-42b8-b569-4396c1b24ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:32.579641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e21f61-bba2-42b8-b569-4396c1b24ccf admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:32.596610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 766/1539] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:32.598524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e21f61-bba2-42b8-b569-4396c1b24ccf admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:32.601036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 774/1540] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:32 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:32.605149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebd9da-897b-469e-a287-bac8d5b345b3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:32.610165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e21f61-bba2-42b8-b569-4396c1b24ccf admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:32.673874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:32.690920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fcfbd-cb46-4464-beb8-5c8d7458685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:32.691326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fcfbd-cb46-4464-beb8-5c8d7458685e admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.691609 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fcfbd-cb46-4464-beb8-5c8d7458685e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.692570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fcfbd-cb46-4464-beb8-5c8d7458685e admin admin] PATH_INFO: `/v3/projects/420d64efa4174da48c02b129d154e6e5/users/7087dbe462964ba7afc65d6808ab8542/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.711642 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fcfbd-cb46-4464-beb8-5c8d7458685e admin admin] RBAC: Authorizing `identity:create_grant(project_id=420d64efa4174da48c02b129d154e6e5, user_id=7087dbe462964ba7afc65d6808ab8542, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:32.714920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fcfbd-cb46-4464-beb8-5c8d7458685e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:32.741460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 767/1541] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:32 2022] PUT /identity/v3/projects/420d64efa4174da48c02b129d154e6e5/users/7087dbe462964ba7afc65d6808ab8542/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:32.745915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fcfbd-cb46-4464-beb8-5c8d7458685e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:32.832830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fcfbd-cb46-4464-beb8-5c8d7458685e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:32.838770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492d7db-5800-4768-883b-97c3ab01cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:32.839516 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d7db-5800-4768-883b-97c3ab01cc43 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.839891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d7db-5800-4768-883b-97c3ab01cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.840259 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d7db-5800-4768-883b-97c3ab01cc43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.841192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492d7db-5800-4768-883b-97c3ab01cc43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:32.844196 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492d7db-5800-4768-883b-97c3ab01cc43 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:32.865665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 768/1542] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:27:32.868826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492d7db-5800-4768-883b-97c3ab01cc43 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:32.882413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492d7db-5800-4768-883b-97c3ab01cc43 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:32.888993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c456d-582a-46e4-a7b2-ca500d9ef597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:32.889752 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c456d-582a-46e4-a7b2-ca500d9ef597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.890092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c456d-582a-46e4-a7b2-ca500d9ef597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.890738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c456d-582a-46e4-a7b2-ca500d9ef597 admin admin] PATH_INFO: `/v3/projects/420d64efa4174da48c02b129d154e6e5/users/7087dbe462964ba7afc65d6808ab8542/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.894672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c456d-582a-46e4-a7b2-ca500d9ef597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420d64efa4174da48c02b129d154e6e5, user_id=7087dbe462964ba7afc65d6808ab8542, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:32.897124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c456d-582a-46e4-a7b2-ca500d9ef597 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:32.902754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebd9da-897b-469e-a287-bac8d5b345b3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:32.922098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 769/1543] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:32 2022] PUT /identity/v3/projects/420d64efa4174da48c02b129d154e6e5/users/7087dbe462964ba7afc65d6808ab8542/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:32.927158 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a61a-b2f1-40ca-aa0b-a9c4ebe7bd8d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:32.927827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a61a-b2f1-40ca-aa0b-a9c4ebe7bd8d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:32.927827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a61a-b2f1-40ca-aa0b-a9c4ebe7bd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:32.978949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-21e8a61a-b2f1-40ca-aa0b-a9c4ebe7bd8d None None] MFA Rules not processed for user `7087dbe462964ba7afc65d6808ab8542`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:32.980331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-21e8a61a-b2f1-40ca-aa0b-a9c4ebe7bd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:32.998646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db8796-b108-4468-afab-7d2c6684fc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:32.999258 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db8796-b108-4468-afab-7d2c6684fc78 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.000246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db8796-b108-4468-afab-7d2c6684fc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.000246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db8796-b108-4468-afab-7d2c6684fc78 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.000823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db8796-b108-4468-afab-7d2c6684fc78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:33.005060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db8796-b108-4468-afab-7d2c6684fc78 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:33.036996 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 775/1544] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:32 2022] POST /identity/v3/users => generated 295 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:33.040190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db8796-b108-4468-afab-7d2c6684fc78 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:33.055816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db8796-b108-4468-afab-7d2c6684fc78 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:33.074569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917aac02-d9fa-4a76-af85-5b22c875bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:33.075107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aac02-d9fa-4a76-af85-5b22c875bb5d admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.075376 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aac02-d9fa-4a76-af85-5b22c875bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.075641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aac02-d9fa-4a76-af85-5b22c875bb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.076386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917aac02-d9fa-4a76-af85-5b22c875bb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:33.079558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917aac02-d9fa-4a76-af85-5b22c875bb5d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:33.100872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 776/1545] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:27:33.101940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917aac02-d9fa-4a76-af85-5b22c875bb5d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:33.126012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917aac02-d9fa-4a76-af85-5b22c875bb5d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:33.131141 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375fc3-3e00-4363-bd01-929e000a28d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:33.131919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375fc3-3e00-4363-bd01-929e000a28d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.132195 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375fc3-3e00-4363-bd01-929e000a28d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.132462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375fc3-3e00-4363-bd01-929e000a28d5 admin admin] PATH_INFO: `/v3/projects/1f23ef4bb72644a2831427751e1be8cc/users/fa3e7e922dad4d3c979084d0ad4dbf9f/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.153419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375fc3-3e00-4363-bd01-929e000a28d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f23ef4bb72644a2831427751e1be8cc, user_id=fa3e7e922dad4d3c979084d0ad4dbf9f, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:33.153533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 770/1546] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:33.153955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375fc3-3e00-4363-bd01-929e000a28d5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:33.181547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8a61a-b2f1-40ca-aa0b-a9c4ebe7bd8d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:33.183213 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-21e8a61a-b2f1-40ca-aa0b-a9c4ebe7bd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:33.186220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 777/1547] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:33 2022] PUT /identity/v3/projects/1f23ef4bb72644a2831427751e1be8cc/users/fa3e7e922dad4d3c979084d0ad4dbf9f/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:33.190523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375fc3-3e00-4363-bd01-929e000a28d5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:33.241542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:33.262269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:33.276819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8a61a-b2f1-40ca-aa0b-a9c4ebe7bd8d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:33.289046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375fc3-3e00-4363-bd01-929e000a28d5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:33.298012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87325a3a-e500-4a71-aa81-0343442b03e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:33.298639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87325a3a-e500-4a71-aa81-0343442b03e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.298899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87325a3a-e500-4a71-aa81-0343442b03e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.299291 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87325a3a-e500-4a71-aa81-0343442b03e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.300540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87325a3a-e500-4a71-aa81-0343442b03e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:33.302260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87325a3a-e500-4a71-aa81-0343442b03e0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:33.315191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 778/1548] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:33.316862 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87325a3a-e500-4a71-aa81-0343442b03e0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:33.319026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-87325a3a-e500-4a71-aa81-0343442b03e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:33.335915 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87325a3a-e500-4a71-aa81-0343442b03e0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:33.342036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:33.342831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.343115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.343384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] PATH_INFO: `/v3/projects/4d09850e886c45cabe094d9b89f1b54b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.344637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d09850e886c45cabe094d9b89f1b54b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:33.346996 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:33.353298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cc4c9-bdaf-4fcb-9089-9d19b70def09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:33.353976 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cc4c9-bdaf-4fcb-9089-9d19b70def09 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.354256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cc4c9-bdaf-4fcb-9089-9d19b70def09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.354703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cc4c9-bdaf-4fcb-9089-9d19b70def09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.413810 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d09850e886c45cabe094d9b89f1b54b', 'request_id': 'req-def22452-aeb1-4d06-aea9-687836486a03'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:33.419559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d09850e886c45cabe094d9b89f1b54b', 'request_id': 'req-def22452-aeb1-4d06-aea9-687836486a03'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:33.428203 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d09850e886c45cabe094d9b89f1b54b', 'request_id': 'req-def22452-aeb1-4d06-aea9-687836486a03'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:33.444284 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] The token cache is being invalidate because project 4d09850e886c45cabe094d9b89f1b54b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:33.444568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:33.445459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:33.446104 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755cc4c9-bdaf-4fcb-9089-9d19b70def09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:33.446999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 779/1549] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:33 2022] DELETE /identity/v3/projects/4d09850e886c45cabe094d9b89f1b54b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:33.447721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:33.448001 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755cc4c9-bdaf-4fcb-9089-9d19b70def09 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:33.449226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:33.459795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 771/1550] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:33.460714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cc4c9-bdaf-4fcb-9089-9d19b70def09 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:33.474840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cc4c9-bdaf-4fcb-9089-9d19b70def09 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:33.563673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def22452-aeb1-4d06-aea9-687836486a03 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:33.575989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e5754-a8be-4052-b937-883e5ffd558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:33.578436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:33.578591 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5754-a8be-4052-b937-883e5ffd558a admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.578826 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5754-a8be-4052-b937-883e5ffd558a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.579104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5754-a8be-4052-b937-883e5ffd558a admin admin] PATH_INFO: `/v3/projects/1f23ef4bb72644a2831427751e1be8cc/users/fa3e7e922dad4d3c979084d0ad4dbf9f/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.579207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.579793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.580445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] PATH_INFO: `/v3/users/e29acb35283a4e5d90bcf56e25d0c8e2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.582902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29acb35283a4e5d90bcf56e25d0c8e2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:33.585409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:33.586196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e5754-a8be-4052-b937-883e5ffd558a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f23ef4bb72644a2831427751e1be8cc, user_id=fa3e7e922dad4d3c979084d0ad4dbf9f, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:33.592479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e5754-a8be-4052-b937-883e5ffd558a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:33.629601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 780/1551] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:33 2022] PUT /identity/v3/projects/1f23ef4bb72644a2831427751e1be8cc/users/fa3e7e922dad4d3c979084d0ad4dbf9f/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:33.640980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184c727-be9b-498d-b27b-fc0038a91c15 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.641214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184c727-be9b-498d-b27b-fc0038a91c15 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.641522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184c727-be9b-498d-b27b-fc0038a91c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.659449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:33.661630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29acb35283a4e5d90bcf56e25d0c8e2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:33.670759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29acb35283a4e5d90bcf56e25d0c8e2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:33.671553 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29acb35283a4e5d90bcf56e25d0c8e2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:33.673796 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4184c727-be9b-498d-b27b-fc0038a91c15 None None] MFA Rules not processed for user `fa3e7e922dad4d3c979084d0ad4dbf9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:33.675064 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4184c727-be9b-498d-b27b-fc0038a91c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:33.685611 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29acb35283a4e5d90bcf56e25d0c8e2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:33.693076 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29acb35283a4e5d90bcf56e25d0c8e2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:33.699276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 772/1552] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:33 2022] DELETE /identity/v3/users/e29acb35283a4e5d90bcf56e25d0c8e2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:33.700060 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:33.701847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:33.727938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:33.759617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 781/1553] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:33.773238 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184c727-be9b-498d-b27b-fc0038a91c15 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:33.774410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a7d2f-f6d9-4a51-8bf0-4490f224e13c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:33.775114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4184c727-be9b-498d-b27b-fc0038a91c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:33.778825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa2c4-c644-4e9d-85af-08701dc2dffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:33.779736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa2c4-c644-4e9d-85af-08701dc2dffc service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.780015 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa2c4-c644-4e9d-85af-08701dc2dffc service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.780282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa2c4-c644-4e9d-85af-08701dc2dffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.782029 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8cefa2c4-c644-4e9d-85af-08701dc2dffc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:33.857183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184c727-be9b-498d-b27b-fc0038a91c15 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:33.858666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefa2c4-c644-4e9d-85af-08701dc2dffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:33.860079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefa2c4-c644-4e9d-85af-08701dc2dffc service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:33.861215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dc945-d42a-4ece-ac6e-f371542fb31b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:33.861919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dc945-d42a-4ece-ac6e-f371542fb31b service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:33.862816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dc945-d42a-4ece-ac6e-f371542fb31b service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:33.862816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dc945-d42a-4ece-ac6e-f371542fb31b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:33.864853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-089dc945-d42a-4ece-ac6e-f371542fb31b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:33.869739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 773/1554] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:33.946032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dc945-d42a-4ece-ac6e-f371542fb31b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:33.947547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dc945-d42a-4ece-ac6e-f371542fb31b service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:33.958374 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 782/1555] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:34.095143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa2c4-c644-4e9d-85af-08701dc2dffc service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:34.098244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8cefa2c4-c644-4e9d-85af-08701dc2dffc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:34.200055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa2c4-c644-4e9d-85af-08701dc2dffc service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:34.206436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:34.206538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:34.206818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:34.207089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] PATH_INFO: `/v3/projects/0f3e51cb73ca44fd89c2c295538796b2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:34.212424 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3e51cb73ca44fd89c2c295538796b2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:34.214481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:34.240980 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:34.291497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3e51cb73ca44fd89c2c295538796b2', 'request_id': 'req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.301684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3e51cb73ca44fd89c2c295538796b2', 'request_id': 'req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.311217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3e51cb73ca44fd89c2c295538796b2', 'request_id': 'req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.318634 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dc945-d42a-4ece-ac6e-f371542fb31b service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:34.320133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-089dc945-d42a-4ece-ac6e-f371542fb31b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:34.328656 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] The token cache is being invalidate because project 0f3e51cb73ca44fd89c2c295538796b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:34.329191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.330150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.332984 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 774/1556] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:34 2022] DELETE /identity/v3/projects/0f3e51cb73ca44fd89c2c295538796b2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:34.339299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:34.340800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:34.344214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dc945-d42a-4ece-ac6e-f371542fb31b service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:34.430159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:34.431132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:34.433104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:34.433449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] PATH_INFO: `/v3/users/338720f71df14aa5ad8c480d078ab8be` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:34.434822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=338720f71df14aa5ad8c480d078ab8be)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:34.437933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:34.520970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f53f9-1d05-4f8d-a91c-79991b62ddb5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:34.532580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:34.535059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:34.535708 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:34.535986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:34.536263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] PATH_INFO: `/v3/users/d9ccbb128d5543e5a83c2ce3f138a50d` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:34.537855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ccbb128d5543e5a83c2ce3f138a50d)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:34.539783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:34.552716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338720f71df14aa5ad8c480d078ab8be'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.552716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338720f71df14aa5ad8c480d078ab8be'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.558439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338720f71df14aa5ad8c480d078ab8be'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.558439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338720f71df14aa5ad8c480d078ab8be'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.577285 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6ff78e20-e47d-4999-bf16-718bd5207cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338720f71df14aa5ad8c480d078ab8be'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.596299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 783/1557] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:34 2022] DELETE /identity/v3/users/338720f71df14aa5ad8c480d078ab8be => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:34.599937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3f94-706e-4373-bff6-e1beb33783dd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:34.599937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3f94-706e-4373-bff6-e1beb33783dd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:34.599937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3f94-706e-4373-bff6-e1beb33783dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:34.602080 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ccbb128d5543e5a83c2ce3f138a50d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.616569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ccbb128d5543e5a83c2ce3f138a50d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.618230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ccbb128d5543e5a83c2ce3f138a50d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.624792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4e9c3f94-706e-4373-bff6-e1beb33783dd None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:34.626155 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4e9c3f94-706e-4373-bff6-e1beb33783dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:34.639489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ccbb128d5543e5a83c2ce3f138a50d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.651805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ccbb128d5543e5a83c2ce3f138a50d'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:34.663433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 775/1558] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:34 2022] DELETE /identity/v3/users/d9ccbb128d5543e5a83c2ce3f138a50d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:34.725958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 784/1559] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:34.734812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:34.736397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:34.782476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:34.817864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1320e6-2de6-464a-9de9-936b910320b2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:34.821697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d5877-17fd-49f4-9252-a59ca160b986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:34.822404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d5877-17fd-49f4-9252-a59ca160b986 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:34.822803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d5877-17fd-49f4-9252-a59ca160b986 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:34.823175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d5877-17fd-49f4-9252-a59ca160b986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:34.939483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d5877-17fd-49f4-9252-a59ca160b986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:34.941973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d5877-17fd-49f4-9252-a59ca160b986 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:34.961387 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 776/1560] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:35.565904 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3f94-706e-4373-bff6-e1beb33783dd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:35.567637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4e9c3f94-706e-4373-bff6-e1beb33783dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:35.673214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3f94-706e-4373-bff6-e1beb33783dd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:35.707734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d5877-17fd-49f4-9252-a59ca160b986 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:35.709227 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-300d5877-17fd-49f4-9252-a59ca160b986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:35.722216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d5877-17fd-49f4-9252-a59ca160b986 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:35.728029 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:35.728835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:35.728967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:35.729261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] PATH_INFO: `/v3/projects/a386535a4e354b5f888ed0366c62e490` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:35.734262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a386535a4e354b5f888ed0366c62e490)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:35.736160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:35.750448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18754ab-0c31-425c-adda-3e588b87af77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:35.750884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18754ab-0c31-425c-adda-3e588b87af77 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:35.751099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18754ab-0c31-425c-adda-3e588b87af77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:35.753620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18754ab-0c31-425c-adda-3e588b87af77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:35.755568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e18754ab-0c31-425c-adda-3e588b87af77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:35.787637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:35.848180 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a386535a4e354b5f888ed0366c62e490', 'request_id': 'req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:35.851127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18754ab-0c31-425c-adda-3e588b87af77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:35.853269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18754ab-0c31-425c-adda-3e588b87af77 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:35.865739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 785/1561] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:35.873098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a386535a4e354b5f888ed0366c62e490', 'request_id': 'req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:35.891219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a386535a4e354b5f888ed0366c62e490', 'request_id': 'req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:35.905307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] The token cache is being invalidate because project a386535a4e354b5f888ed0366c62e490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:35.905714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:35.906405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-840796d9-ddaa-4a6c-aac9-7d985e3a1ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:35.913065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 777/1562] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:35 2022] DELETE /identity/v3/projects/a386535a4e354b5f888ed0366c62e490 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:35.916050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f911cb-b78b-4c9d-894d-eb7a556ae9ec None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:35.916636 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f911cb-b78b-4c9d-894d-eb7a556ae9ec None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:35.917237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f911cb-b78b-4c9d-894d-eb7a556ae9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:35.978351 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b1f911cb-b78b-4c9d-894d-eb7a556ae9ec None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:35.982270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b1f911cb-b78b-4c9d-894d-eb7a556ae9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:36.120648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 786/1563] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:36.122336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6eddb-35e5-4e71-9625-55617434f44c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.122626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6eddb-35e5-4e71-9625-55617434f44c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.122901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6eddb-35e5-4e71-9625-55617434f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.157747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9ea6eddb-35e5-4e71-9625-55617434f44c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:36.161405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9ea6eddb-35e5-4e71-9625-55617434f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:36.179657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 778/1564] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:36.181565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f911cb-b78b-4c9d-894d-eb7a556ae9ec None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:36.195657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f911cb-b78b-4c9d-894d-eb7a556ae9ec None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:36.202786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b0ac1-a806-48ae-8e79-2a123a76c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:36.204108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0ac1-a806-48ae-8e79-2a123a76c064 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.204545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0ac1-a806-48ae-8e79-2a123a76c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.204812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b0ac1-a806-48ae-8e79-2a123a76c064 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.206275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b0ac1-a806-48ae-8e79-2a123a76c064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:36.206386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b0ac1-a806-48ae-8e79-2a123a76c064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:36.208912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b0ac1-a806-48ae-8e79-2a123a76c064 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:36.250262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6eddb-35e5-4e71-9625-55617434f44c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:36.250743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 787/1565] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:36.264086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6eddb-35e5-4e71-9625-55617434f44c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:36.285232 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aa766-abb2-436f-b0d1-844e2cbb4d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:36.286157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aa766-abb2-436f-b0d1-844e2cbb4d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.286647 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aa766-abb2-436f-b0d1-844e2cbb4d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.287213 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aa766-abb2-436f-b0d1-844e2cbb4d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.302612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aa766-abb2-436f-b0d1-844e2cbb4d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:36.304575 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aa766-abb2-436f-b0d1-844e2cbb4d25 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:36.377817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 779/1566] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:36 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:36.382545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b0ac1-a806-48ae-8e79-2a123a76c064 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:36.409730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b0ac1-a806-48ae-8e79-2a123a76c064 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:36.484934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd46512-5935-4aac-ab8c-6c20b125c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:36.485692 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd46512-5935-4aac-ab8c-6c20b125c61e admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.486045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd46512-5935-4aac-ab8c-6c20b125c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.486399 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd46512-5935-4aac-ab8c-6c20b125c61e admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.487648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd46512-5935-4aac-ab8c-6c20b125c61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:36.489768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd46512-5935-4aac-ab8c-6c20b125c61e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:36.522891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 788/1567] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:36 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:36.525259 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aa766-abb2-436f-b0d1-844e2cbb4d25 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:36.544896 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aa766-abb2-436f-b0d1-844e2cbb4d25 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:36.564121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557bd6f-2ef9-4fe7-a73f-144d6462ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:36.565934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557bd6f-2ef9-4fe7-a73f-144d6462ff8f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.566274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557bd6f-2ef9-4fe7-a73f-144d6462ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.566548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557bd6f-2ef9-4fe7-a73f-144d6462ff8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.567223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557bd6f-2ef9-4fe7-a73f-144d6462ff8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:36.569601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557bd6f-2ef9-4fe7-a73f-144d6462ff8f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:36.581675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd46512-5935-4aac-ab8c-6c20b125c61e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:36.582174 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 780/1568] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:36.586677 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7dd46512-5935-4aac-ab8c-6c20b125c61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:36.586918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557bd6f-2ef9-4fe7-a73f-144d6462ff8f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:36.604744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd46512-5935-4aac-ab8c-6c20b125c61e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:36.610064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557bd6f-2ef9-4fe7-a73f-144d6462ff8f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:36.611693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:36.613829 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.614148 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.614573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] PATH_INFO: `/v3/projects/a368158fe7c240609876084630be3caa` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.615960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a368158fe7c240609876084630be3caa)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:36.617931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001deee-76b1-432f-abea-03cc2df96e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:36.618489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:36.619590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001deee-76b1-432f-abea-03cc2df96e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.619942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001deee-76b1-432f-abea-03cc2df96e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.620281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001deee-76b1-432f-abea-03cc2df96e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.621154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001deee-76b1-432f-abea-03cc2df96e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:36.623159 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001deee-76b1-432f-abea-03cc2df96e3e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:36.639071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 781/1569] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:36.640004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001deee-76b1-432f-abea-03cc2df96e3e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:36.651464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001deee-76b1-432f-abea-03cc2df96e3e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:36.657898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f5c74-9372-482c-8002-b109a6bb16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:36.659692 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5c74-9372-482c-8002-b109a6bb16e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.659975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5c74-9372-482c-8002-b109a6bb16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.660301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5c74-9372-482c-8002-b109a6bb16e9 admin admin] PATH_INFO: `/v3/projects/eadc91ff979642729d97cb984ddd1626/users/f398bd43a7474833a35909b7e16bac5b/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.676205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:36.680065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:36.688420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f5c74-9372-482c-8002-b109a6bb16e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadc91ff979642729d97cb984ddd1626, user_id=f398bd43a7474833a35909b7e16bac5b, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:36.691634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f5c74-9372-482c-8002-b109a6bb16e9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:36.692524 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a368158fe7c240609876084630be3caa', 'request_id': 'req-edecc134-2d7d-4046-bf3f-9c041c6b921a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:36.699702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a368158fe7c240609876084630be3caa', 'request_id': 'req-edecc134-2d7d-4046-bf3f-9c041c6b921a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:36.706805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a368158fe7c240609876084630be3caa', 'request_id': 'req-edecc134-2d7d-4046-bf3f-9c041c6b921a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:36.709512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 782/1570] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:36 2022] PUT /identity/v3/projects/eadc91ff979642729d97cb984ddd1626/users/f398bd43a7474833a35909b7e16bac5b/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:36.724074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc766428-5578-4fcf-b866-961abf48be9f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.724343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc766428-5578-4fcf-b866-961abf48be9f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.724648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc766428-5578-4fcf-b866-961abf48be9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.727368 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] The token cache is being invalidate because project a368158fe7c240609876084630be3caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:36.727669 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:36.728345 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:36.730920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 789/1571] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:36 2022] DELETE /identity/v3/projects/a368158fe7c240609876084630be3caa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:36.734641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:36.736159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:36.761648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cc766428-5578-4fcf-b866-961abf48be9f None None] MFA Rules not processed for user `f398bd43a7474833a35909b7e16bac5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:36.762741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cc766428-5578-4fcf-b866-961abf48be9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:36.807721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecc134-2d7d-4046-bf3f-9c041c6b921a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:36.841084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 783/1572] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:36.854007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc766428-5578-4fcf-b866-961abf48be9f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:36.855878 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cc766428-5578-4fcf-b866-961abf48be9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:36.874347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:36.874800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.875478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.875478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] PATH_INFO: `/v3/users/7087dbe462964ba7afc65d6808ab8542` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.877210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7087dbe462964ba7afc65d6808ab8542)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:36.879823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:36.941963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc766428-5578-4fcf-b866-961abf48be9f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:36.948103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bc1da-82bd-43e7-baad-a49c00dded55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:36.948838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bc1da-82bd-43e7-baad-a49c00dded55 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:36.949065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bc1da-82bd-43e7-baad-a49c00dded55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:36.949345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bc1da-82bd-43e7-baad-a49c00dded55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:36.955408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7087dbe462964ba7afc65d6808ab8542'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:36.956336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7087dbe462964ba7afc65d6808ab8542'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:36.962750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1bc1da-82bd-43e7-baad-a49c00dded55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:36.964277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1bc1da-82bd-43e7-baad-a49c00dded55 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:36.967726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7087dbe462964ba7afc65d6808ab8542'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:36.968562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7087dbe462964ba7afc65d6808ab8542'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:36.976268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 784/1573] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:36.981994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:36.989223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b934602b-ab38-4ed4-941e-7c775d12c2f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7087dbe462964ba7afc65d6808ab8542'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:37.007673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 790/1574] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:36 2022] DELETE /identity/v3/users/7087dbe462964ba7afc65d6808ab8542 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:37.810518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bc1da-82bd-43e7-baad-a49c00dded55 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:37.832517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bc1da-82bd-43e7-baad-a49c00dded55 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:37.968153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:37.969449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:37.969753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:37.970011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] PATH_INFO: `/v3/projects/420d64efa4174da48c02b129d154e6e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:37.971173 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=420d64efa4174da48c02b129d154e6e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:37.976126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:38.011906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:38.043798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420d64efa4174da48c02b129d154e6e5', 'request_id': 'req-1418c607-81c2-4fd7-82f5-0b16e5a16d51'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:38.052841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420d64efa4174da48c02b129d154e6e5', 'request_id': 'req-1418c607-81c2-4fd7-82f5-0b16e5a16d51'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:38.059853 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420d64efa4174da48c02b129d154e6e5', 'request_id': 'req-1418c607-81c2-4fd7-82f5-0b16e5a16d51'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:38.075296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] The token cache is being invalidate because project 420d64efa4174da48c02b129d154e6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:38.075663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:38.076470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1418c607-81c2-4fd7-82f5-0b16e5a16d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:38.078231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 785/1575] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:37 2022] DELETE /identity/v3/projects/420d64efa4174da48c02b129d154e6e5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:38.083674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca4ac-5778-4d8f-ae1f-d68c07462309 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.084165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca4ac-5778-4d8f-ae1f-d68c07462309 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.084256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca4ac-5778-4d8f-ae1f-d68c07462309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.104305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-367ca4ac-5778-4d8f-ae1f-d68c07462309 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:38.105559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-367ca4ac-5778-4d8f-ae1f-d68c07462309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:38.175157 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 791/1576] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:38.182816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006463-4062-48a0-b537-0fdb48045a31 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.183101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006463-4062-48a0-b537-0fdb48045a31 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.183372 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4006463-4062-48a0-b537-0fdb48045a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.213148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f4006463-4062-48a0-b537-0fdb48045a31 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:38.213148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f4006463-4062-48a0-b537-0fdb48045a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:38.216939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 786/1577] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:38.223307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ca4ac-5778-4d8f-ae1f-d68c07462309 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:38.233469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ca4ac-5778-4d8f-ae1f-d68c07462309 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:38.239898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110921b-00e5-455a-946d-3386b228eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:38.239898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110921b-00e5-455a-946d-3386b228eae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.240165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110921b-00e5-455a-946d-3386b228eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.240546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110921b-00e5-455a-946d-3386b228eae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.241378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4006463-4062-48a0-b537-0fdb48045a31 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:38.241515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110921b-00e5-455a-946d-3386b228eae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:38.241750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110921b-00e5-455a-946d-3386b228eae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:38.242711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f4006463-4062-48a0-b537-0fdb48045a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:38.243600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110921b-00e5-455a-946d-3386b228eae0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:38.255234 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4006463-4062-48a0-b537-0fdb48045a31 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:38.256190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 792/1578] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:38.260450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110921b-00e5-455a-946d-3386b228eae0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:38.261149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:38.261986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.262266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.262535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] PATH_INFO: `/v3/users/eae621ede1fc4737873b376efbcb1755` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.263672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae621ede1fc4737873b376efbcb1755)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:38.265772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:38.270816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110921b-00e5-455a-946d-3386b228eae0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:38.275594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ef62e-5452-45bf-a5b2-baac0a43156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:38.276181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef62e-5452-45bf-a5b2-baac0a43156d admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.276456 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef62e-5452-45bf-a5b2-baac0a43156d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.276746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef62e-5452-45bf-a5b2-baac0a43156d admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.277403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ef62e-5452-45bf-a5b2-baac0a43156d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:38.279266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ef62e-5452-45bf-a5b2-baac0a43156d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:38.316743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 793/1579] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:38 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:27:38.320726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ef62e-5452-45bf-a5b2-baac0a43156d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:38.330282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae621ede1fc4737873b376efbcb1755'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:38.340426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae621ede1fc4737873b376efbcb1755'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:38.341085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae621ede1fc4737873b376efbcb1755'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:38.357211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae621ede1fc4737873b376efbcb1755'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:38.365629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d9e9d0ff-8dfd-4656-8c15-eada58c0546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae621ede1fc4737873b376efbcb1755'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:38.376705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 787/1580] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:38 2022] DELETE /identity/v3/users/eae621ede1fc4737873b376efbcb1755 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:38.379011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841175e-488d-46fb-b02d-05e9d9a73855 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.379352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841175e-488d-46fb-b02d-05e9d9a73855 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.379695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841175e-488d-46fb-b02d-05e9d9a73855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.403181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ef62e-5452-45bf-a5b2-baac0a43156d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:38.408138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f841175e-488d-46fb-b02d-05e9d9a73855 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:38.411376 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f841175e-488d-46fb-b02d-05e9d9a73855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:38.478356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:38.486616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da984e3-09a8-4158-84fb-917f500234c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:38.488262 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da984e3-09a8-4158-84fb-917f500234c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.488731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da984e3-09a8-4158-84fb-917f500234c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.489457 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da984e3-09a8-4158-84fb-917f500234c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.490535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da984e3-09a8-4158-84fb-917f500234c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:38.493553 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da984e3-09a8-4158-84fb-917f500234c3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:38.514343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 788/1581] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:38.526403 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841175e-488d-46fb-b02d-05e9d9a73855 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:38.528309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f841175e-488d-46fb-b02d-05e9d9a73855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:38.528796 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 794/1582] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:38 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:27:38.534136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da984e3-09a8-4158-84fb-917f500234c3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:38.536160 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3da984e3-09a8-4158-84fb-917f500234c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:38.552228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da984e3-09a8-4158-84fb-917f500234c3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:38.557853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b3aa5-51fd-4bc9-b749-14be9de23d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:38.558622 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3aa5-51fd-4bc9-b749-14be9de23d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.558998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3aa5-51fd-4bc9-b749-14be9de23d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.559464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3aa5-51fd-4bc9-b749-14be9de23d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.561892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b3aa5-51fd-4bc9-b749-14be9de23d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:38.563742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b3aa5-51fd-4bc9-b749-14be9de23d42 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:38.573770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:38.584310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 795/1583] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:38.586530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b3aa5-51fd-4bc9-b749-14be9de23d42 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:38.603465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b3aa5-51fd-4bc9-b749-14be9de23d42 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:38.611187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c718-4b82-4daf-8298-2969eb8b20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:38.612407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c718-4b82-4daf-8298-2969eb8b20cb admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.613306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c718-4b82-4daf-8298-2969eb8b20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.613599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c718-4b82-4daf-8298-2969eb8b20cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.615078 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c718-4b82-4daf-8298-2969eb8b20cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:38.617277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c718-4b82-4daf-8298-2969eb8b20cb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:38.631895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 796/1584] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:38.641809 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c718-4b82-4daf-8298-2969eb8b20cb admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:38.664502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c718-4b82-4daf-8298-2969eb8b20cb admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:38.678045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841175e-488d-46fb-b02d-05e9d9a73855 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:38.684426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508ae63-f3b4-44e2-88b6-ce4c96e06ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:38.685421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508ae63-f3b4-44e2-88b6-ce4c96e06ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.685770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508ae63-f3b4-44e2-88b6-ce4c96e06ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.686114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508ae63-f3b4-44e2-88b6-ce4c96e06ac7 admin admin] PATH_INFO: `/v3/projects/973cdaf22fdc4c9a9bcb954a6d6b33ca/users/20823a4c8bb841e4808ed8e7c5339115/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.692061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965de66-2eb1-4fb5-bd9c-8ef51f18ddc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:38.692766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965de66-2eb1-4fb5-bd9c-8ef51f18ddc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.693194 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965de66-2eb1-4fb5-bd9c-8ef51f18ddc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.693524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965de66-2eb1-4fb5-bd9c-8ef51f18ddc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.710896 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965de66-2eb1-4fb5-bd9c-8ef51f18ddc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:38.712437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965de66-2eb1-4fb5-bd9c-8ef51f18ddc6 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:38.725500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 789/1585] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:38.725721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508ae63-f3b4-44e2-88b6-ce4c96e06ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973cdaf22fdc4c9a9bcb954a6d6b33ca, user_id=20823a4c8bb841e4808ed8e7c5339115, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:38.728708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508ae63-f3b4-44e2-88b6-ce4c96e06ac7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:38.761574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e5d0-1b53-4c1f-bee7-eb5387c87f6b None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:38.762078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e5d0-1b53-4c1f-bee7-eb5387c87f6b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:38.762521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e5d0-1b53-4c1f-bee7-eb5387c87f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:38.763010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 797/1586] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:38 2022] PUT /identity/v3/projects/973cdaf22fdc4c9a9bcb954a6d6b33ca/users/20823a4c8bb841e4808ed8e7c5339115/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:38.831729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3e26e5d0-1b53-4c1f-bee7-eb5387c87f6b None None] MFA Rules not processed for user `20823a4c8bb841e4808ed8e7c5339115`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:38.834508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3e26e5d0-1b53-4c1f-bee7-eb5387c87f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:39.058760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 790/1587] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:27:39.067928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508ae63-f3b4-44e2-88b6-ce4c96e06ac7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:39.069984 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3508ae63-f3b4-44e2-88b6-ce4c96e06ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:39.163701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508ae63-f3b4-44e2-88b6-ce4c96e06ac7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:39.177381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefa8d6-2c00-477e-bcfc-5c3a30e4d4df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:39.178018 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefa8d6-2c00-477e-bcfc-5c3a30e4d4df service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:39.178298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefa8d6-2c00-477e-bcfc-5c3a30e4d4df service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:39.178568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefa8d6-2c00-477e-bcfc-5c3a30e4d4df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:39.198452 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefa8d6-2c00-477e-bcfc-5c3a30e4d4df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:39.199911 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefa8d6-2c00-477e-bcfc-5c3a30e4d4df service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:39.226745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 798/1588] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:39.263573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e5d0-1b53-4c1f-bee7-eb5387c87f6b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:39.394507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefa8d6-2c00-477e-bcfc-5c3a30e4d4df service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:39.396123 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7fefa8d6-2c00-477e-bcfc-5c3a30e4d4df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:39.412714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e5d0-1b53-4c1f-bee7-eb5387c87f6b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:39.423058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:39.424008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:39.427776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:39.428245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] PATH_INFO: `/v3/users/20823a4c8bb841e4808ed8e7c5339115` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:39.430129 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20823a4c8bb841e4808ed8e7c5339115)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:39.431260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefa8d6-2c00-477e-bcfc-5c3a30e4d4df service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:39.434161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:39.439991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:39.441713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:39.441995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:39.442323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] PATH_INFO: `/v3/projects/c1259df5f776461290cad8d320566d84` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:39.454799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1259df5f776461290cad8d320566d84)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:39.459751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:39.546543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20823a4c8bb841e4808ed8e7c5339115'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.555857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1259df5f776461290cad8d320566d84', 'request_id': 'req-e566bb18-48b8-4b59-9d0d-a68340e3b532'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.563354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:39.578344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20823a4c8bb841e4808ed8e7c5339115'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.579513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1259df5f776461290cad8d320566d84', 'request_id': 'req-e566bb18-48b8-4b59-9d0d-a68340e3b532'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.580692 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20823a4c8bb841e4808ed8e7c5339115'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.594883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1259df5f776461290cad8d320566d84', 'request_id': 'req-e566bb18-48b8-4b59-9d0d-a68340e3b532'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.608387 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20823a4c8bb841e4808ed8e7c5339115'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.615478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] The token cache is being invalidate because project c1259df5f776461290cad8d320566d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:39.615773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.616676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.618867 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 799/1589] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:39 2022] DELETE /identity/v3/projects/c1259df5f776461290cad8d320566d84 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:39.622476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:39.626933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:39.627892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f0aff570-0d58-4e21-a374-c89c5c25d0e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20823a4c8bb841e4808ed8e7c5339115'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.642426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 791/1590] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:39 2022] DELETE /identity/v3/users/20823a4c8bb841e4808ed8e7c5339115 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:39.648314 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02113fc-63bc-4289-9fb4-996263af7376 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:39.648855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02113fc-63bc-4289-9fb4-996263af7376 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:39.649786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02113fc-63bc-4289-9fb4-996263af7376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:39.682285 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:39.706458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a02113fc-63bc-4289-9fb4-996263af7376 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:39.707664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a02113fc-63bc-4289-9fb4-996263af7376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:39.728683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566bb18-48b8-4b59-9d0d-a68340e3b532 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:39.774878 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 792/1591] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:39.785175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02113fc-63bc-4289-9fb4-996263af7376 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:39.787073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a02113fc-63bc-4289-9fb4-996263af7376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:39.797997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:39.798733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:39.799072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:39.799498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] PATH_INFO: `/v3/users/2a97b1f68c9c4b73b176a0ebf7a8080a` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:39.801412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a97b1f68c9c4b73b176a0ebf7a8080a)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:39.803385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:39.856698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02113fc-63bc-4289-9fb4-996263af7376 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:39.863621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba7fdf-5cd9-43b0-9071-4bf5ec2615b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:39.864559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba7fdf-5cd9-43b0-9071-4bf5ec2615b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:39.865303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba7fdf-5cd9-43b0-9071-4bf5ec2615b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:39.865303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba7fdf-5cd9-43b0-9071-4bf5ec2615b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:39.871073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a97b1f68c9c4b73b176a0ebf7a8080a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.872273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a97b1f68c9c4b73b176a0ebf7a8080a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.877680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba7fdf-5cd9-43b0-9071-4bf5ec2615b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:39.880381 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba7fdf-5cd9-43b0-9071-4bf5ec2615b2 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:39.881333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a97b1f68c9c4b73b176a0ebf7a8080a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.882068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a97b1f68c9c4b73b176a0ebf7a8080a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.894012 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 793/1592] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:39.899746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a97b1f68c9c4b73b176a0ebf7a8080a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:39.923132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 800/1593] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:39 2022] DELETE /identity/v3/users/2a97b1f68c9c4b73b176a0ebf7a8080a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:40.199074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba7fdf-5cd9-43b0-9071-4bf5ec2615b2 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:40.200693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b7ba7fdf-5cd9-43b0-9071-4bf5ec2615b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:40.218689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba7fdf-5cd9-43b0-9071-4bf5ec2615b2 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:40.304600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:40.306768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:40.312355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:40.313267 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:40.313540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:40.313807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] PATH_INFO: `/v3/projects/973cdaf22fdc4c9a9bcb954a6d6b33ca` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:40.315481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973cdaf22fdc4c9a9bcb954a6d6b33ca)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:40.317499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:40.329549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:40.334608 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db7408-8ae3-4914-b075-3574f305c648 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:40.341528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:40.342248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:40.342433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:40.342709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] PATH_INFO: `/v3/projects/84afbf3c5f1b468ba79d21a31394028d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:40.344040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84afbf3c5f1b468ba79d21a31394028d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:40.346128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:40.389709 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973cdaf22fdc4c9a9bcb954a6d6b33ca', 'request_id': 'req-b13f455f-88d7-42b0-a9ac-db2045f385d1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.406776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973cdaf22fdc4c9a9bcb954a6d6b33ca', 'request_id': 'req-b13f455f-88d7-42b0-a9ac-db2045f385d1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.418136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:40.420280 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84afbf3c5f1b468ba79d21a31394028d', 'request_id': 'req-872587df-c5b8-4ffc-8cea-a215f8846407'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.420971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973cdaf22fdc4c9a9bcb954a6d6b33ca', 'request_id': 'req-b13f455f-88d7-42b0-a9ac-db2045f385d1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.429597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84afbf3c5f1b468ba79d21a31394028d', 'request_id': 'req-872587df-c5b8-4ffc-8cea-a215f8846407'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.435932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] The token cache is being invalidate because project 973cdaf22fdc4c9a9bcb954a6d6b33ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:40.436393 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.437246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84afbf3c5f1b468ba79d21a31394028d', 'request_id': 'req-872587df-c5b8-4ffc-8cea-a215f8846407'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.438091 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.441052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 794/1594] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:40 2022] DELETE /identity/v3/projects/973cdaf22fdc4c9a9bcb954a6d6b33ca => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:40.441447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:40.442800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:40.461412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] The token cache is being invalidate because project 84afbf3c5f1b468ba79d21a31394028d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:40.462265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.463477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-872587df-c5b8-4ffc-8cea-a215f8846407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.466045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 801/1595] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:40 2022] DELETE /identity/v3/projects/84afbf3c5f1b468ba79d21a31394028d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:40.468263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387e67-fd38-44f7-ad9a-38a3d203f351 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:40.468728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387e67-fd38-44f7-ad9a-38a3d203f351 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:40.469590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387e67-fd38-44f7-ad9a-38a3d203f351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:40.499158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a3387e67-fd38-44f7-ad9a-38a3d203f351 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:40.500756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a3387e67-fd38-44f7-ad9a-38a3d203f351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:40.551973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f455f-88d7-42b0-a9ac-db2045f385d1 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:40.631663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 802/1596] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:40.632639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f7819-a2c6-4cdd-b7bb-38f434442874 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:40.632639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f7819-a2c6-4cdd-b7bb-38f434442874 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:40.632639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f7819-a2c6-4cdd-b7bb-38f434442874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:40.676458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d28f7819-a2c6-4cdd-b7bb-38f434442874 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:40.677742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d28f7819-a2c6-4cdd-b7bb-38f434442874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:40.686106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:40.686875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:40.687525 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 803/1597] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:40.689164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:40.689164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] PATH_INFO: `/v3/users/0b09f32458f44614b2b5c8679d3419a5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:40.689394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73010e75-171e-45c5-b9c6-cc95cd0206a1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:40.689610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73010e75-171e-45c5-b9c6-cc95cd0206a1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:40.689881 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73010e75-171e-45c5-b9c6-cc95cd0206a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:40.692191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b09f32458f44614b2b5c8679d3419a5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:40.694802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:40.734543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-73010e75-171e-45c5-b9c6-cc95cd0206a1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:40.740150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-73010e75-171e-45c5-b9c6-cc95cd0206a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:40.761868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 804/1598] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:40.763601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625180-71ce-4f50-bbdb-70b9aa357d0e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:40.763969 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625180-71ce-4f50-bbdb-70b9aa357d0e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:40.764336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625180-71ce-4f50-bbdb-70b9aa357d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:40.798673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-14625180-71ce-4f50-bbdb-70b9aa357d0e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:40.800054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-14625180-71ce-4f50-bbdb-70b9aa357d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:40.812648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 805/1599] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:40.812648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14625180-71ce-4f50-bbdb-70b9aa357d0e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:40.821180 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b09f32458f44614b2b5c8679d3419a5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.822586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14625180-71ce-4f50-bbdb-70b9aa357d0e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:40.824257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:40.832301 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d0e21-f052-42bb-a6e0-4403d9158d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:40.835288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d0e21-f052-42bb-a6e0-4403d9158d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:40.835727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d0e21-f052-42bb-a6e0-4403d9158d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:40.836140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d0e21-f052-42bb-a6e0-4403d9158d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:40.837277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d0e21-f052-42bb-a6e0-4403d9158d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:40.837901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d0e21-f052-42bb-a6e0-4403d9158d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:40.840747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d0e21-f052-42bb-a6e0-4403d9158d40 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:40.841921 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b09f32458f44614b2b5c8679d3419a5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.842806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b09f32458f44614b2b5c8679d3419a5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.863190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 806/1600] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:40.863190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d0e21-f052-42bb-a6e0-4403d9158d40 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:40.864209 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1b2d0e21-f052-42bb-a6e0-4403d9158d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:40.865793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b09f32458f44614b2b5c8679d3419a5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.874646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b09f32458f44614b2b5c8679d3419a5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:40.898377 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d0e21-f052-42bb-a6e0-4403d9158d40 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:40.900556 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 795/1601] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:40 2022] DELETE /identity/v3/users/0b09f32458f44614b2b5c8679d3419a5 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:40.901991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:40.904187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:40.982876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c14db-7615-47c9-9d79-25d6c72896af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:40.983544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c14db-7615-47c9-9d79-25d6c72896af admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:40.983646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a996e3f-d4aa-48eb-a428-45bc0e601583 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:40.983827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c14db-7615-47c9-9d79-25d6c72896af admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:40.984096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c14db-7615-47c9-9d79-25d6c72896af admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:40.984737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c14db-7615-47c9-9d79-25d6c72896af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:40.985061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c14db-7615-47c9-9d79-25d6c72896af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:40.986649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c14db-7615-47c9-9d79-25d6c72896af admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:40.988449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601d1d8-2018-4abf-b5dd-afa1827ce456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:40.989078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601d1d8-2018-4abf-b5dd-afa1827ce456 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:40.989401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601d1d8-2018-4abf-b5dd-afa1827ce456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:40.989670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601d1d8-2018-4abf-b5dd-afa1827ce456 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:40.990300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601d1d8-2018-4abf-b5dd-afa1827ce456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:40.992468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601d1d8-2018-4abf-b5dd-afa1827ce456 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.001117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 807/1602] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:41.001404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1a3e5-e36a-4243-8eaf-6a8a28f3589d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.001686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1a3e5-e36a-4243-8eaf-6a8a28f3589d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.001957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1a3e5-e36a-4243-8eaf-6a8a28f3589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.023371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-10d1a3e5-e36a-4243-8eaf-6a8a28f3589d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:41.024712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 796/1603] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:40 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:41.024840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-10d1a3e5-e36a-4243-8eaf-6a8a28f3589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:41.025707 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601d1d8-2018-4abf-b5dd-afa1827ce456 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.059177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:41.089441 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601d1d8-2018-4abf-b5dd-afa1827ce456 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.091488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 808/1604] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:41.092258 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1a3e5-e36a-4243-8eaf-6a8a28f3589d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.100961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfce86-36d3-4563-aab2-ea5fecfa31f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.101622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfce86-36d3-4563-aab2-ea5fecfa31f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.101896 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfce86-36d3-4563-aab2-ea5fecfa31f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.102161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfce86-36d3-4563-aab2-ea5fecfa31f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.102310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1a3e5-e36a-4243-8eaf-6a8a28f3589d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.103187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfce86-36d3-4563-aab2-ea5fecfa31f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.105238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfce86-36d3-4563-aab2-ea5fecfa31f8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.109782 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1db5e8-d2fb-4838-a330-cf0c06b19cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.110512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db5e8-d2fb-4838-a330-cf0c06b19cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.110819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db5e8-d2fb-4838-a330-cf0c06b19cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.111394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1db5e8-d2fb-4838-a330-cf0c06b19cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.111791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1db5e8-d2fb-4838-a330-cf0c06b19cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.113939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1db5e8-d2fb-4838-a330-cf0c06b19cc0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.138936 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 809/1605] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:41 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:41.140265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1db5e8-d2fb-4838-a330-cf0c06b19cc0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.141597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ef1db5e8-d2fb-4838-a330-cf0c06b19cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:41.145801 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 797/1606] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:41 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:41.146897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfce86-36d3-4563-aab2-ea5fecfa31f8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.199037 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:41.214707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1db5e8-d2fb-4838-a330-cf0c06b19cc0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.226813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfce86-36d3-4563-aab2-ea5fecfa31f8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.231727 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fd4d3-fec0-469a-9533-ab20e3deab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.232411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fd4d3-fec0-469a-9533-ab20e3deab6f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.232783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fd4d3-fec0-469a-9533-ab20e3deab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.233140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fd4d3-fec0-469a-9533-ab20e3deab6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.233974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fd4d3-fec0-469a-9533-ab20e3deab6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.235643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fd4d3-fec0-469a-9533-ab20e3deab6f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.248627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 798/1607] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:41.249510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fd4d3-fec0-469a-9533-ab20e3deab6f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.261373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fd4d3-fec0-469a-9533-ab20e3deab6f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.266192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7eac6-fa28-4fe7-9bf6-e93a5ea84fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.266798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7eac6-fa28-4fe7-9bf6-e93a5ea84fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.267071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7eac6-fa28-4fe7-9bf6-e93a5ea84fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.267342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7eac6-fa28-4fe7-9bf6-e93a5ea84fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.267975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7eac6-fa28-4fe7-9bf6-e93a5ea84fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.270640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7eac6-fa28-4fe7-9bf6-e93a5ea84fd3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.290409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fc6fb-525d-4f26-a7ca-1386e9ce832d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.291217 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fc6fb-525d-4f26-a7ca-1386e9ce832d service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.291490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fc6fb-525d-4f26-a7ca-1386e9ce832d service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.291786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fc6fb-525d-4f26-a7ca-1386e9ce832d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.294796 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 799/1608] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:41 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:41.295815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7eac6-fa28-4fe7-9bf6-e93a5ea84fd3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.302527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fc6fb-525d-4f26-a7ca-1386e9ce832d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.303730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fc6fb-525d-4f26-a7ca-1386e9ce832d service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.307270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7eac6-fa28-4fe7-9bf6-e93a5ea84fd3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.313840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f217e10-65df-44b4-9bf4-039a999491db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.314443 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f217e10-65df-44b4-9bf4-039a999491db admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.314900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f217e10-65df-44b4-9bf4-039a999491db admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.315570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 810/1609] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:41.316005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f217e10-65df-44b4-9bf4-039a999491db admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.316858 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f217e10-65df-44b4-9bf4-039a999491db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.316965 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fc6fb-525d-4f26-a7ca-1386e9ce832d service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.318087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f217e10-65df-44b4-9bf4-039a999491db admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.327179 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fc6fb-525d-4f26-a7ca-1386e9ce832d service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.332271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 800/1610] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:41.336355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f217e10-65df-44b4-9bf4-039a999491db admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.337466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cf7bf-639c-4756-abf8-69abfca958e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.338077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cf7bf-639c-4756-abf8-69abfca958e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.338350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cf7bf-639c-4756-abf8-69abfca958e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.338635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cf7bf-639c-4756-abf8-69abfca958e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.339257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cf7bf-639c-4756-abf8-69abfca958e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.341922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cf7bf-639c-4756-abf8-69abfca958e3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.358335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f217e10-65df-44b4-9bf4-039a999491db admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.367913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51486ff-d0cc-4075-b3e9-a3b403af0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.368228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 811/1611] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:41.369477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51486ff-d0cc-4075-b3e9-a3b403af0ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.369791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51486ff-d0cc-4075-b3e9-a3b403af0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.370071 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51486ff-d0cc-4075-b3e9-a3b403af0ac2 admin admin] PATH_INFO: `/v3/projects/0fd4656602a84bc78bf1c34da0e14cc1/users/2117f4de5ce248579f8096f4a6a03f39/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.372245 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cf7bf-639c-4756-abf8-69abfca958e3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.391070 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51486ff-d0cc-4075-b3e9-a3b403af0ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd4656602a84bc78bf1c34da0e14cc1, user_id=2117f4de5ce248579f8096f4a6a03f39, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.393086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cf7bf-639c-4756-abf8-69abfca958e3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.394629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51486ff-d0cc-4075-b3e9-a3b403af0ac2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.400820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54547a1-58a5-4945-b006-26ad16badc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.401534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54547a1-58a5-4945-b006-26ad16badc47 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.401814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54547a1-58a5-4945-b006-26ad16badc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.402087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54547a1-58a5-4945-b006-26ad16badc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.402735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54547a1-58a5-4945-b006-26ad16badc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.404675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54547a1-58a5-4945-b006-26ad16badc47 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.414874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 801/1612] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:41 2022] PUT /identity/v3/projects/0fd4656602a84bc78bf1c34da0e14cc1/users/2117f4de5ce248579f8096f4a6a03f39/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:41.418047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 812/1613] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:27:41.423141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51486ff-d0cc-4075-b3e9-a3b403af0ac2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.426464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628bbe5-4731-4829-96b5-457821b2d4e3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.426840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628bbe5-4731-4829-96b5-457821b2d4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.427201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628bbe5-4731-4829-96b5-457821b2d4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.473879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5628bbe5-4731-4829-96b5-457821b2d4e3 None None] MFA Rules not processed for user `2117f4de5ce248579f8096f4a6a03f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:41.475495 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5628bbe5-4731-4829-96b5-457821b2d4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:41.552231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:41.553300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51486ff-d0cc-4075-b3e9-a3b403af0ac2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.558810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936427be-16b0-4dd7-b71c-0a4220e63301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.559613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936427be-16b0-4dd7-b71c-0a4220e63301 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.559891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936427be-16b0-4dd7-b71c-0a4220e63301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.560156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936427be-16b0-4dd7-b71c-0a4220e63301 admin admin] PATH_INFO: `/v3/projects/c790f11557394303bb552922b138ad58/users/870ff1b019504e37b76bab5139256092/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.584159 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936427be-16b0-4dd7-b71c-0a4220e63301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c790f11557394303bb552922b138ad58, user_id=870ff1b019504e37b76bab5139256092, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.585053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 813/1614] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:27:41.592316 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936427be-16b0-4dd7-b71c-0a4220e63301 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.610093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628bbe5-4731-4829-96b5-457821b2d4e3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.610515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 802/1615] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:41 2022] PUT /identity/v3/projects/c790f11557394303bb552922b138ad58/users/870ff1b019504e37b76bab5139256092/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:41.617175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5628bbe5-4731-4829-96b5-457821b2d4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:41.623138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db2e2c-1c0e-4ba9-b489-523ad3e36f98 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.623554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db2e2c-1c0e-4ba9-b489-523ad3e36f98 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.623929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db2e2c-1c0e-4ba9-b489-523ad3e36f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.683490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d7db2e2c-1c0e-4ba9-b489-523ad3e36f98 None None] MFA Rules not processed for user `870ff1b019504e37b76bab5139256092`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:41.683490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d7db2e2c-1c0e-4ba9-b489-523ad3e36f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:41.719200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628bbe5-4731-4829-96b5-457821b2d4e3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.782783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:41.783154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672fcc7-d94a-4ad1-ac4f-1befb836ad55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.784986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672fcc7-d94a-4ad1-ac4f-1befb836ad55 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.785407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672fcc7-d94a-4ad1-ac4f-1befb836ad55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.785775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672fcc7-d94a-4ad1-ac4f-1befb836ad55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.818498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 803/1616] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:27:41.819246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db2e2c-1c0e-4ba9-b489-523ad3e36f98 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.820586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d7db2e2c-1c0e-4ba9-b489-523ad3e36f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:41.863055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672fcc7-d94a-4ad1-ac4f-1befb836ad55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.864897 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672fcc7-d94a-4ad1-ac4f-1befb836ad55 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.875142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 814/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:41.876414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01abd7a-d106-41aa-bb15-9420def246c9 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.876730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01abd7a-d106-41aa-bb15-9420def246c9 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.877001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01abd7a-d106-41aa-bb15-9420def246c9 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.879056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 815/1618] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:27:41.879822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01abd7a-d106-41aa-bb15-9420def246c9 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:41.934795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db2e2c-1c0e-4ba9-b489-523ad3e36f98 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.941396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.942310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.942840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.943209 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] PATH_INFO: `/v3/projects/039416be4a644cefb100a0b572fbb166` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:41.944478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039416be4a644cefb100a0b572fbb166)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:41.946657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:41.974664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:41.983586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01abd7a-d106-41aa-bb15-9420def246c9 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:41.995233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0b581-179a-4a77-9a8c-f4f89866f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:41.995864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0b581-179a-4a77-9a8c-f4f89866f8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:41.996140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0b581-179a-4a77-9a8c-f4f89866f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:41.996551 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0b581-179a-4a77-9a8c-f4f89866f8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:42.009958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0b581-179a-4a77-9a8c-f4f89866f8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:42.012644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0b581-179a-4a77-9a8c-f4f89866f8d2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:42.016284 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039416be4a644cefb100a0b572fbb166', 'request_id': 'req-793a6fda-895b-4ea9-a6aa-49a7318918b5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.041049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039416be4a644cefb100a0b572fbb166', 'request_id': 'req-793a6fda-895b-4ea9-a6aa-49a7318918b5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.053458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039416be4a644cefb100a0b572fbb166', 'request_id': 'req-793a6fda-895b-4ea9-a6aa-49a7318918b5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.069912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] The token cache is being invalidate because project 039416be4a644cefb100a0b572fbb166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:42.070615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.071499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.073667 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 804/1619] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:41 2022] DELETE /identity/v3/projects/039416be4a644cefb100a0b572fbb166 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:42.074787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:42.077428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:42.101287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 816/1620] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:41 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:42.105701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b591-0d9f-4143-8165-94e7cd4fddf8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:42.106013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b591-0d9f-4143-8165-94e7cd4fddf8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:42.106448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b591-0d9f-4143-8165-94e7cd4fddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:42.154298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f749b591-0d9f-4143-8165-94e7cd4fddf8 None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:42.155069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f749b591-0d9f-4143-8165-94e7cd4fddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:42.230947 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a6fda-895b-4ea9-a6aa-49a7318918b5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:42.277649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 817/1621] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:27:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:42.278594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749b591-0d9f-4143-8165-94e7cd4fddf8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:42.280711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f749b591-0d9f-4143-8165-94e7cd4fddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:42.284843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:42.336693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:42.337541 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:42.337818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:42.338541 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] PATH_INFO: `/v3/users/2117f4de5ce248579f8096f4a6a03f39` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:42.339740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2117f4de5ce248579f8096f4a6a03f39)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:42.343115 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:42.382448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749b591-0d9f-4143-8165-94e7cd4fddf8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:42.389850 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:42.390574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:42.390853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:42.391200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] PATH_INFO: `/v3/users/fa3e7e922dad4d3c979084d0ad4dbf9f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:42.392569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3e7e922dad4d3c979084d0ad4dbf9f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:42.395268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:42.422969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2117f4de5ce248579f8096f4a6a03f39'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.437124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2117f4de5ce248579f8096f4a6a03f39'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.438003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2117f4de5ce248579f8096f4a6a03f39'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.456478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3e7e922dad4d3c979084d0ad4dbf9f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.458254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3e7e922dad4d3c979084d0ad4dbf9f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.459321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2117f4de5ce248579f8096f4a6a03f39'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.467547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2117f4de5ce248579f8096f4a6a03f39'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.468442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3e7e922dad4d3c979084d0ad4dbf9f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.469674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3e7e922dad4d3c979084d0ad4dbf9f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.474973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 805/1622] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:42 2022] DELETE /identity/v3/users/2117f4de5ce248579f8096f4a6a03f39 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:42.478301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:42.478301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:42.492803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3e7e922dad4d3c979084d0ad4dbf9f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:42.495975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:42.514580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 818/1623] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:42 2022] DELETE /identity/v3/users/fa3e7e922dad4d3c979084d0ad4dbf9f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:42.515883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:42.531500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:42.588908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1846c-f893-4236-a745-74272dfc12ec admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:42.658409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879e888-6d25-4191-8e69-5d4a022c3537 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:42.670670 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f00d4-5fe8-4bbd-b47c-2a327bb63550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:42.671661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f00d4-5fe8-4bbd-b47c-2a327bb63550 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:42.673125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f00d4-5fe8-4bbd-b47c-2a327bb63550 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:42.673635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f00d4-5fe8-4bbd-b47c-2a327bb63550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:42.676456 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-628f00d4-5fe8-4bbd-b47c-2a327bb63550 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:42.678700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:42.690640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eeceb-5f07-4701-a12f-f7e7df202f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:42.692034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eeceb-5f07-4701-a12f-f7e7df202f22 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:42.692648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eeceb-5f07-4701-a12f-f7e7df202f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:42.694169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eeceb-5f07-4701-a12f-f7e7df202f22 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:42.696024 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eeceb-5f07-4701-a12f-f7e7df202f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:42.696821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f00d4-5fe8-4bbd-b47c-2a327bb63550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:42.699105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f00d4-5fe8-4bbd-b47c-2a327bb63550 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:42.702490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eeceb-5f07-4701-a12f-f7e7df202f22 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:42.715955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 819/1624] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:42.717889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184689f2-31be-44f4-af11-4c332ac9750c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:42.718766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184689f2-31be-44f4-af11-4c332ac9750c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:42.719145 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184689f2-31be-44f4-af11-4c332ac9750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:42.738359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 806/1625] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:42 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:42.739429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eeceb-5f07-4701-a12f-f7e7df202f22 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:42.742673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a83eeceb-5f07-4701-a12f-f7e7df202f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:42.745683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-184689f2-31be-44f4-af11-4c332ac9750c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:42.747094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-184689f2-31be-44f4-af11-4c332ac9750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:42.758504 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 820/1626] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:42.768426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184689f2-31be-44f4-af11-4c332ac9750c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:42.770736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eeceb-5f07-4701-a12f-f7e7df202f22 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:42.773154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-184689f2-31be-44f4-af11-4c332ac9750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:42.780332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207459-d31d-427f-94d4-b8367a0e6264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:42.781183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207459-d31d-427f-94d4-b8367a0e6264 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:42.781620 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207459-d31d-427f-94d4-b8367a0e6264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:42.782799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6207459-d31d-427f-94d4-b8367a0e6264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:42.784527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6207459-d31d-427f-94d4-b8367a0e6264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:42.786850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6207459-d31d-427f-94d4-b8367a0e6264 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:42.801670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 807/1627] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:42.807855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207459-d31d-427f-94d4-b8367a0e6264 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:42.822530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6207459-d31d-427f-94d4-b8367a0e6264 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:42.830549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303fac0-59aa-4f16-abfc-17317f9d9f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:42.831835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303fac0-59aa-4f16-abfc-17317f9d9f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:42.832264 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303fac0-59aa-4f16-abfc-17317f9d9f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:42.832643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303fac0-59aa-4f16-abfc-17317f9d9f86 admin admin] PATH_INFO: `/v3/projects/9af64847d97e478ba7421cf709144426/users/1e11dcd2b2b84465b0e4a1bbcac3d16c/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:42.855099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303fac0-59aa-4f16-abfc-17317f9d9f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af64847d97e478ba7421cf709144426, user_id=1e11dcd2b2b84465b0e4a1bbcac3d16c, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:42.859274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303fac0-59aa-4f16-abfc-17317f9d9f86 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:42.881208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 808/1628] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:42 2022] PUT /identity/v3/projects/9af64847d97e478ba7421cf709144426/users/1e11dcd2b2b84465b0e4a1bbcac3d16c/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:42.885493 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303fac0-59aa-4f16-abfc-17317f9d9f86 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:42.913354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184689f2-31be-44f4-af11-4c332ac9750c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.019160 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf712c-18a6-4937-9c0c-e81769cd115b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.020337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf712c-18a6-4937-9c0c-e81769cd115b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.021464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf712c-18a6-4937-9c0c-e81769cd115b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.021948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf712c-18a6-4937-9c0c-e81769cd115b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.031474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303fac0-59aa-4f16-abfc-17317f9d9f86 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.040273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf712c-18a6-4937-9c0c-e81769cd115b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.050033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf712c-18a6-4937-9c0c-e81769cd115b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.052132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d26d7-adff-4f4e-98a2-e413097a6cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.052765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d26d7-adff-4f4e-98a2-e413097a6cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.053046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d26d7-adff-4f4e-98a2-e413097a6cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.053321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d26d7-adff-4f4e-98a2-e413097a6cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.053965 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d26d7-adff-4f4e-98a2-e413097a6cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.055571 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d26d7-adff-4f4e-98a2-e413097a6cb0 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.064203 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 821/1629] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:43.065370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf712c-18a6-4937-9c0c-e81769cd115b service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:43.066813 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f2cf712c-18a6-4937-9c0c-e81769cd115b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:43.076873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 809/1630] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:27:43.081296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf712c-18a6-4937-9c0c-e81769cd115b service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.082046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d26d7-adff-4f4e-98a2-e413097a6cb0 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:43.088068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.089240 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.089618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.089983 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] PATH_INFO: `/v3/projects/1f23ef4bb72644a2831427751e1be8cc` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.091650 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f23ef4bb72644a2831427751e1be8cc)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.093932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.100266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d26d7-adff-4f4e-98a2-e413097a6cb0 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.107674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9d58b-4c28-4551-a669-24e7a7503716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.109221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9d58b-4c28-4551-a669-24e7a7503716 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.110055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9d58b-4c28-4551-a669-24e7a7503716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.110491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9d58b-4c28-4551-a669-24e7a7503716 admin admin] PATH_INFO: `/v3/projects/9af64847d97e478ba7421cf709144426/users/1e11dcd2b2b84465b0e4a1bbcac3d16c/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.116111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9d58b-4c28-4551-a669-24e7a7503716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af64847d97e478ba7421cf709144426, user_id=1e11dcd2b2b84465b0e4a1bbcac3d16c, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.120169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9d58b-4c28-4551-a669-24e7a7503716 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.136319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 810/1631] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:43 2022] PUT /identity/v3/projects/9af64847d97e478ba7421cf709144426/users/1e11dcd2b2b84465b0e4a1bbcac3d16c/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:43.148077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:43.153816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a661-8380-4062-bc78-9b9a8b82ab3c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.155288 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a661-8380-4062-bc78-9b9a8b82ab3c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.155702 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9a661-8380-4062-bc78-9b9a8b82ab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.183863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f23ef4bb72644a2831427751e1be8cc', 'request_id': 'req-848502be-2486-4ac7-99b3-c34c4312df8a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:43.192741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f23ef4bb72644a2831427751e1be8cc', 'request_id': 'req-848502be-2486-4ac7-99b3-c34c4312df8a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:43.196999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9ef9a661-8380-4062-bc78-9b9a8b82ab3c None None] MFA Rules not processed for user `1e11dcd2b2b84465b0e4a1bbcac3d16c`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:43.198723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9ef9a661-8380-4062-bc78-9b9a8b82ab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:43.199893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f23ef4bb72644a2831427751e1be8cc', 'request_id': 'req-848502be-2486-4ac7-99b3-c34c4312df8a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:43.218574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] The token cache is being invalidate because project 1f23ef4bb72644a2831427751e1be8cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:43.219475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:43.221145 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:43.224644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 822/1632] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:43 2022] DELETE /identity/v3/projects/1f23ef4bb72644a2831427751e1be8cc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:43.226299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:43.228430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:43.319701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848502be-2486-4ac7-99b3-c34c4312df8a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.335543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.337326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.337326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.338424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] PATH_INFO: `/v3/users/f398bd43a7474833a35909b7e16bac5b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.341131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 811/1633] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:43.342834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc21452-bce8-4504-9daa-123761013a2e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.343394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc21452-bce8-4504-9daa-123761013a2e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.344218 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc21452-bce8-4504-9daa-123761013a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.346658 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f398bd43a7474833a35909b7e16bac5b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.354440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.382521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0bc21452-bce8-4504-9daa-123761013a2e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:43.384187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0bc21452-bce8-4504-9daa-123761013a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:43.396416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 812/1634] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:43.397588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc21452-bce8-4504-9daa-123761013a2e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:43.398998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0bc21452-bce8-4504-9daa-123761013a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:43.437088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:43.458283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f398bd43a7474833a35909b7e16bac5b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:43.460266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f398bd43a7474833a35909b7e16bac5b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:43.479128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f398bd43a7474833a35909b7e16bac5b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:43.481299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f398bd43a7474833a35909b7e16bac5b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:43.516917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc21452-bce8-4504-9daa-123761013a2e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.518889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e2beb8d5-c8d5-4bb3-9a41-1de2f0a1b739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f398bd43a7474833a35909b7e16bac5b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:43.525358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dcb2a-bce5-424e-8c55-a12587055751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.526466 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dcb2a-bce5-424e-8c55-a12587055751 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.526775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dcb2a-bce5-424e-8c55-a12587055751 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.527120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dcb2a-bce5-424e-8c55-a12587055751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.529183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-795dcb2a-bce5-424e-8c55-a12587055751 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:43.538691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 823/1635] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:43 2022] DELETE /identity/v3/users/f398bd43a7474833a35909b7e16bac5b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:43.544000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d45b6a-a917-44f7-a7d9-df014d5f4937 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.544479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d45b6a-a917-44f7-a7d9-df014d5f4937 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.544956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d45b6a-a917-44f7-a7d9-df014d5f4937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.545318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dcb2a-bce5-424e-8c55-a12587055751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.546908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dcb2a-bce5-424e-8c55-a12587055751 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.570845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c4d45b6a-a917-44f7-a7d9-df014d5f4937 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:43.572329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 813/1636] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:43.572713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c4d45b6a-a917-44f7-a7d9-df014d5f4937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:43.576736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911adcbe-7f93-4175-a0a1-114b2a3bc8ab None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.577049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911adcbe-7f93-4175-a0a1-114b2a3bc8ab None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.577329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911adcbe-7f93-4175-a0a1-114b2a3bc8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.624599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:43.660940 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-911adcbe-7f93-4175-a0a1-114b2a3bc8ab None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:43.673256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-911adcbe-7f93-4175-a0a1-114b2a3bc8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:43.681518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 824/1637] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:43.686444 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d45b6a-a917-44f7-a7d9-df014d5f4937 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:43.696916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 814/1638] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:43.701118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d45b6a-a917-44f7-a7d9-df014d5f4937 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.706902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911adcbe-7f93-4175-a0a1-114b2a3bc8ab None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:43.707935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accec49-1a97-4599-9aee-39692cddaafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.708634 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accec49-1a97-4599-9aee-39692cddaafd admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.708977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accec49-1a97-4599-9aee-39692cddaafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.709361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accec49-1a97-4599-9aee-39692cddaafd admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.709764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-911adcbe-7f93-4175-a0a1-114b2a3bc8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:43.710325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accec49-1a97-4599-9aee-39692cddaafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:43.710709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accec49-1a97-4599-9aee-39692cddaafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.714445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accec49-1a97-4599-9aee-39692cddaafd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.737744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 825/1639] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:43.738649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accec49-1a97-4599-9aee-39692cddaafd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:43.749257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accec49-1a97-4599-9aee-39692cddaafd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.754314 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28108d4-2f08-45de-9386-59f73cd0aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.755006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28108d4-2f08-45de-9386-59f73cd0aaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.755351 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28108d4-2f08-45de-9386-59f73cd0aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.755687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28108d4-2f08-45de-9386-59f73cd0aaf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.756389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28108d4-2f08-45de-9386-59f73cd0aaf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.758361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28108d4-2f08-45de-9386-59f73cd0aaf3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.793415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 826/1640] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:43 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:43.794236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911adcbe-7f93-4175-a0a1-114b2a3bc8ab None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.797587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28108d4-2f08-45de-9386-59f73cd0aaf3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:43.870141 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28108d4-2f08-45de-9386-59f73cd0aaf3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.877437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf81f1-9164-47e3-a7ce-86a40ba71471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.878872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf81f1-9164-47e3-a7ce-86a40ba71471 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.879272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf81f1-9164-47e3-a7ce-86a40ba71471 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.879700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf81f1-9164-47e3-a7ce-86a40ba71471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.883726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d59f-68c1-42f0-ad75-031a508cdb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.884811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d59f-68c1-42f0-ad75-031a508cdb91 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.885189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d59f-68c1-42f0-ad75-031a508cdb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.885556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d59f-68c1-42f0-ad75-031a508cdb91 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.886325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194d59f-68c1-42f0-ad75-031a508cdb91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.890832 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194d59f-68c1-42f0-ad75-031a508cdb91 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.893894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf81f1-9164-47e3-a7ce-86a40ba71471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.896460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf81f1-9164-47e3-a7ce-86a40ba71471 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.923944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 827/1641] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:43 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:27:43.924092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 815/1642] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:43.925410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf81f1-9164-47e3-a7ce-86a40ba71471 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:43.943579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf81f1-9164-47e3-a7ce-86a40ba71471 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.945438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d59f-68c1-42f0-ad75-031a508cdb91 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:43.951286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5194d59f-68c1-42f0-ad75-031a508cdb91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:43.952537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f801-8cd5-4ab0-81dc-6f95c6b96006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.954274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f801-8cd5-4ab0-81dc-6f95c6b96006 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.957212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f801-8cd5-4ab0-81dc-6f95c6b96006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.957520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f801-8cd5-4ab0-81dc-6f95c6b96006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.961146 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7f801-8cd5-4ab0-81dc-6f95c6b96006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.965322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7f801-8cd5-4ab0-81dc-6f95c6b96006 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.968213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d59f-68c1-42f0-ad75-031a508cdb91 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:43.980266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:43.981250 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:43.981677 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:43.982016 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] PATH_INFO: `/v3/projects/0fd4656602a84bc78bf1c34da0e14cc1` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:43.984313 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd4656602a84bc78bf1c34da0e14cc1)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:43.987633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:43.993880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 816/1643] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:44.001956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f801-8cd5-4ab0-81dc-6f95c6b96006 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.013313 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f801-8cd5-4ab0-81dc-6f95c6b96006 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.022307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfff17-be46-4bea-8cde-89bb5fab57ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.023670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfff17-be46-4bea-8cde-89bb5fab57ab admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.023670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfff17-be46-4bea-8cde-89bb5fab57ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.024098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfff17-be46-4bea-8cde-89bb5fab57ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.025152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfff17-be46-4bea-8cde-89bb5fab57ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.027342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfff17-be46-4bea-8cde-89bb5fab57ab admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:44.041148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 817/1644] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:44.044495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfff17-be46-4bea-8cde-89bb5fab57ab admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.060036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfff17-be46-4bea-8cde-89bb5fab57ab admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.071201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d501c-dc19-4110-806f-029117840683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.072064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d501c-dc19-4110-806f-029117840683 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.072566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d501c-dc19-4110-806f-029117840683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.073221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d501c-dc19-4110-806f-029117840683 admin admin] PATH_INFO: `/v3/projects/33f3b2be9f82423895435391e354361a/users/6b644c26073c483a813fcd6413be4457/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.084420 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd4656602a84bc78bf1c34da0e14cc1', 'request_id': 'req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.091913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd4656602a84bc78bf1c34da0e14cc1', 'request_id': 'req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.100483 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd4656602a84bc78bf1c34da0e14cc1', 'request_id': 'req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.100661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d501c-dc19-4110-806f-029117840683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f3b2be9f82423895435391e354361a, user_id=6b644c26073c483a813fcd6413be4457, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.104148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d501c-dc19-4110-806f-029117840683 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:44.118541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] The token cache is being invalidate because project 0fd4656602a84bc78bf1c34da0e14cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:44.118934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.119607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f9ec3e2d-ae7b-4bf8-a3cb-3aaab366c1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.121484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 828/1645] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:43 2022] DELETE /identity/v3/projects/0fd4656602a84bc78bf1c34da0e14cc1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:44.123874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 818/1646] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:44 2022] PUT /identity/v3/projects/33f3b2be9f82423895435391e354361a/users/6b644c26073c483a813fcd6413be4457/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:44.130125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1219cf-0c73-4c1f-bfca-2bb5118f0937 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.135770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d45704-07c1-45d4-935f-a462149e0b28 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.136277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d45704-07c1-45d4-935f-a462149e0b28 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.136449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d45704-07c1-45d4-935f-a462149e0b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.137960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1219cf-0c73-4c1f-bfca-2bb5118f0937 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.138422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1219cf-0c73-4c1f-bfca-2bb5118f0937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.163230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6a1219cf-0c73-4c1f-bfca-2bb5118f0937 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:44.164559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6a1219cf-0c73-4c1f-bfca-2bb5118f0937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.172240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-67d45704-07c1-45d4-935f-a462149e0b28 None None] MFA Rules not processed for user `6b644c26073c483a813fcd6413be4457`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:44.173514 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-67d45704-07c1-45d4-935f-a462149e0b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.183059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:44.202247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:44.263142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 819/1647] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:27:44.265985 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d45704-07c1-45d4-935f-a462149e0b28 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.267629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-67d45704-07c1-45d4-935f-a462149e0b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.330050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 829/1648] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:44.330050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1219cf-0c73-4c1f-bfca-2bb5118f0937 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.330050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6a1219cf-0c73-4c1f-bfca-2bb5118f0937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.351596 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1219cf-0c73-4c1f-bfca-2bb5118f0937 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.358442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.359153 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.361196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.363458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] PATH_INFO: `/v3/projects/eadc91ff979642729d97cb984ddd1626` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.364871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadc91ff979642729d97cb984ddd1626)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.369105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:44.398107 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d45704-07c1-45d4-935f-a462149e0b28 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.404269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4029e2-5569-4808-94c4-03831efcea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.405200 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4029e2-5569-4808-94c4-03831efcea77 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.405477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4029e2-5569-4808-94c4-03831efcea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.405745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4029e2-5569-4808-94c4-03831efcea77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.406380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4029e2-5569-4808-94c4-03831efcea77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.409290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4029e2-5569-4808-94c4-03831efcea77 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:44.447974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 820/1649] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:44 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:44.447974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f28bbb-3316-488d-a6d8-de4c2a8bf004 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.447974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f28bbb-3316-488d-a6d8-de4c2a8bf004 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.447974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f28bbb-3316-488d-a6d8-de4c2a8bf004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.454688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadc91ff979642729d97cb984ddd1626', 'request_id': 'req-e125ba3e-f928-4b24-8712-ad6eb95764b2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.460323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadc91ff979642729d97cb984ddd1626', 'request_id': 'req-e125ba3e-f928-4b24-8712-ad6eb95764b2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.466828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-29f28bbb-3316-488d-a6d8-de4c2a8bf004 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:44.467305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadc91ff979642729d97cb984ddd1626', 'request_id': 'req-e125ba3e-f928-4b24-8712-ad6eb95764b2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.468023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-29f28bbb-3316-488d-a6d8-de4c2a8bf004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.481890 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] The token cache is being invalidate because project eadc91ff979642729d97cb984ddd1626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:44.482188 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.482802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.484307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 830/1650] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:44 2022] DELETE /identity/v3/projects/eadc91ff979642729d97cb984ddd1626 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:44.485829 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.487932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.531257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 821/1651] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:44.532106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f28bbb-3316-488d-a6d8-de4c2a8bf004 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.535537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-29f28bbb-3316-488d-a6d8-de4c2a8bf004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.547441 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f28bbb-3316-488d-a6d8-de4c2a8bf004 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.552972 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6664a5-08b7-48ce-ba0d-8469ca1ee385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.553606 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6664a5-08b7-48ce-ba0d-8469ca1ee385 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.553908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6664a5-08b7-48ce-ba0d-8469ca1ee385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.554175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6664a5-08b7-48ce-ba0d-8469ca1ee385 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.554802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6664a5-08b7-48ce-ba0d-8469ca1ee385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.556743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6664a5-08b7-48ce-ba0d-8469ca1ee385 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:44.566601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125ba3e-f928-4b24-8712-ad6eb95764b2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.572268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.573292 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.573607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.573975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] PATH_INFO: `/v3/users/870ff1b019504e37b76bab5139256092` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.575107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870ff1b019504e37b76bab5139256092)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.577405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:44.581862 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 822/1652] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:44 2022] POST /identity/v3/users => generated 300 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:44.582987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd1a9-9f53-47eb-acad-3a7d6dd13f79 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.583274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd1a9-9f53-47eb-acad-3a7d6dd13f79 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.583542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd1a9-9f53-47eb-acad-3a7d6dd13f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.609274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-dc0fd1a9-9f53-47eb-acad-3a7d6dd13f79 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:44.610652 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dc0fd1a9-9f53-47eb-acad-3a7d6dd13f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.629078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 823/1653] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:44.629078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fd1a9-9f53-47eb-acad-3a7d6dd13f79 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.639198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fd1a9-9f53-47eb-acad-3a7d6dd13f79 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.642071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:44.647308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96acbe-12be-4493-bfcd-25253679aeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.647941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96acbe-12be-4493-bfcd-25253679aeba admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.648222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96acbe-12be-4493-bfcd-25253679aeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.648491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96acbe-12be-4493-bfcd-25253679aeba admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.649181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96acbe-12be-4493-bfcd-25253679aeba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:44.649485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96acbe-12be-4493-bfcd-25253679aeba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.651177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96acbe-12be-4493-bfcd-25253679aeba admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:44.659672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:44.661385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870ff1b019504e37b76bab5139256092'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.663498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870ff1b019504e37b76bab5139256092'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.666342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 824/1654] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:44.668298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96acbe-12be-4493-bfcd-25253679aeba admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.678051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870ff1b019504e37b76bab5139256092'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.678994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870ff1b019504e37b76bab5139256092'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.682008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96acbe-12be-4493-bfcd-25253679aeba admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.687243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbffe27-cbf6-431d-a90d-f342a78f982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.688767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbffe27-cbf6-431d-a90d-f342a78f982b admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.689152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbffe27-cbf6-431d-a90d-f342a78f982b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.689493 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbffe27-cbf6-431d-a90d-f342a78f982b admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.690949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbffe27-cbf6-431d-a90d-f342a78f982b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.693037 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbffe27-cbf6-431d-a90d-f342a78f982b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:44.695015 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870ff1b019504e37b76bab5139256092'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:44.709137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 825/1655] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:44.709137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e6457-64de-4113-b3af-d93e83d16f57 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.709137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e6457-64de-4113-b3af-d93e83d16f57 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.709137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e6457-64de-4113-b3af-d93e83d16f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.725532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 831/1656] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:44 2022] DELETE /identity/v3/users/870ff1b019504e37b76bab5139256092 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:44.726600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.728244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.729409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-754e6457-64de-4113-b3af-d93e83d16f57 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:44.730992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-754e6457-64de-4113-b3af-d93e83d16f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.808911 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2743c48-6e34-419c-b255-2869ab050748 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.815513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5c626-fb2d-4963-bbbf-f554468c397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.816477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5c626-fb2d-4963-bbbf-f554468c397a admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.817064 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5c626-fb2d-4963-bbbf-f554468c397a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.817525 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5c626-fb2d-4963-bbbf-f554468c397a admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.818234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5c626-fb2d-4963-bbbf-f554468c397a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.820211 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5c626-fb2d-4963-bbbf-f554468c397a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:44.844362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 826/1657] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:44.845230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e6457-64de-4113-b3af-d93e83d16f57 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.847979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-754e6457-64de-4113-b3af-d93e83d16f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.856426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 832/1658] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:44 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:44.856426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c2348-b2ef-4648-afdf-956aa1304fd3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.856426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c2348-b2ef-4648-afdf-956aa1304fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.856426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c2348-b2ef-4648-afdf-956aa1304fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.862755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e6457-64de-4113-b3af-d93e83d16f57 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.876342 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-aa9c2348-b2ef-4648-afdf-956aa1304fd3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:44.878016 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-aa9c2348-b2ef-4648-afdf-956aa1304fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:44.951753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ef69-780b-45b6-b183-2421ba8a73fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.952482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ef69-780b-45b6-b183-2421ba8a73fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.952747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ef69-780b-45b6-b183-2421ba8a73fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.953041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ef69-780b-45b6-b183-2421ba8a73fd admin admin] PATH_INFO: `/v3/projects/f92bb47dbc094dbaa5cb521b0a8fe9ee/users/bce78f404c874defb2dda264b2fcfd0e/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.965173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 833/1659] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:44.966563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c2348-b2ef-4648-afdf-956aa1304fd3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:44.980645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c2348-b2ef-4648-afdf-956aa1304fd3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:44.984097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ef69-780b-45b6-b183-2421ba8a73fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92bb47dbc094dbaa5cb521b0a8fe9ee, user_id=bce78f404c874defb2dda264b2fcfd0e, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.987813 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0bcb5-fdcb-4238-91d9-9c681f524e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:44.988493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0bcb5-fdcb-4238-91d9-9c681f524e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:44.988800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0bcb5-fdcb-4238-91d9-9c681f524e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:44.989183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ef69-780b-45b6-b183-2421ba8a73fd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:44.989299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0bcb5-fdcb-4238-91d9-9c681f524e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:44.990462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0bcb5-fdcb-4238-91d9-9c681f524e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:44.991007 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0bcb5-fdcb-4238-91d9-9c681f524e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:44.994186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0bcb5-fdcb-4238-91d9-9c681f524e77 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.009098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 827/1660] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:44 2022] PUT /identity/v3/projects/f92bb47dbc094dbaa5cb521b0a8fe9ee/users/bce78f404c874defb2dda264b2fcfd0e/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:45.010365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ef69-780b-45b6-b183-2421ba8a73fd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.016098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 834/1661] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:45.017188 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0bcb5-fdcb-4238-91d9-9c681f524e77 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.018992 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0bf0bcb5-fdcb-4238-91d9-9c681f524e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:45.066075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:45.120776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0bcb5-fdcb-4238-91d9-9c681f524e77 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.144142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ef69-780b-45b6-b183-2421ba8a73fd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.150560 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20f14-4d83-46f3-9269-de4a43eba23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.151392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20f14-4d83-46f3-9269-de4a43eba23c admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.152261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20f14-4d83-46f3-9269-de4a43eba23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.152691 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20f14-4d83-46f3-9269-de4a43eba23c admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.153530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20f14-4d83-46f3-9269-de4a43eba23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.156605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20f14-4d83-46f3-9269-de4a43eba23c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.178198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:45.184399 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18621617-9ae0-434c-8f26-a5c19e3b56c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.185059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18621617-9ae0-434c-8f26-a5c19e3b56c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.185343 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18621617-9ae0-434c-8f26-a5c19e3b56c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.185632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 828/1662] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:45 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:45.185632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20f14-4d83-46f3-9269-de4a43eba23c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.188852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18621617-9ae0-434c-8f26-a5c19e3b56c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.199928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20f14-4d83-46f3-9269-de4a43eba23c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.201375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18621617-9ae0-434c-8f26-a5c19e3b56c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.206600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18621617-9ae0-434c-8f26-a5c19e3b56c1 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.207312 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eabd7e-c531-40bc-8b63-0693bd97e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.207935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eabd7e-c531-40bc-8b63-0693bd97e6ca admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.208212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eabd7e-c531-40bc-8b63-0693bd97e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.208486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eabd7e-c531-40bc-8b63-0693bd97e6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.209166 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eabd7e-c531-40bc-8b63-0693bd97e6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.210824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eabd7e-c531-40bc-8b63-0693bd97e6ca admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.226452 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 829/1663] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:45.227829 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 835/1664] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:45.228941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18621617-9ae0-434c-8f26-a5c19e3b56c1 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.238024 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eabd7e-c531-40bc-8b63-0693bd97e6ca admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.244798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18621617-9ae0-434c-8f26-a5c19e3b56c1 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.249941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54af41-d083-4b2b-96a0-c2e74220bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.250174 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eabd7e-c531-40bc-8b63-0693bd97e6ca admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.250818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54af41-d083-4b2b-96a0-c2e74220bdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.251153 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54af41-d083-4b2b-96a0-c2e74220bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.251372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54af41-d083-4b2b-96a0-c2e74220bdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.251993 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54af41-d083-4b2b-96a0-c2e74220bdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.253749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54af41-d083-4b2b-96a0-c2e74220bdc3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.255659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c476e-2714-436d-b625-51b6bca063cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.256271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c476e-2714-436d-b625-51b6bca063cf admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.256549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c476e-2714-436d-b625-51b6bca063cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.256822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c476e-2714-436d-b625-51b6bca063cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.257504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c476e-2714-436d-b625-51b6bca063cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.259397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c476e-2714-436d-b625-51b6bca063cf admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.266093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 836/1665] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:45.270146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54af41-d083-4b2b-96a0-c2e74220bdc3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.286215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54af41-d083-4b2b-96a0-c2e74220bdc3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.292327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934bac8-d765-44cf-a21c-07cd36d6b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.292973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 830/1666] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:45 2022] POST /identity/v3/projects => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:45.293229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934bac8-d765-44cf-a21c-07cd36d6b23c admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.293565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934bac8-d765-44cf-a21c-07cd36d6b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.293837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c476e-2714-436d-b625-51b6bca063cf admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.293948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934bac8-d765-44cf-a21c-07cd36d6b23c admin admin] PATH_INFO: `/v3/projects/f92bb47dbc094dbaa5cb521b0a8fe9ee/users/bce78f404c874defb2dda264b2fcfd0e/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.297632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934bac8-d765-44cf-a21c-07cd36d6b23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92bb47dbc094dbaa5cb521b0a8fe9ee, user_id=bce78f404c874defb2dda264b2fcfd0e, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.300672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934bac8-d765-44cf-a21c-07cd36d6b23c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.317059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 837/1667] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:45 2022] PUT /identity/v3/projects/f92bb47dbc094dbaa5cb521b0a8fe9ee/users/bce78f404c874defb2dda264b2fcfd0e/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:45.317059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934bac8-d765-44cf-a21c-07cd36d6b23c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.370993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c476e-2714-436d-b625-51b6bca063cf admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.387742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934bac8-d765-44cf-a21c-07cd36d6b23c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.393522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab470e21-aeb0-44fa-930c-c2906d8a53e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.394173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab470e21-aeb0-44fa-930c-c2906d8a53e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.394604 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab470e21-aeb0-44fa-930c-c2906d8a53e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.395624 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab470e21-aeb0-44fa-930c-c2906d8a53e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.396272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab470e21-aeb0-44fa-930c-c2906d8a53e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.398351 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab470e21-aeb0-44fa-930c-c2906d8a53e1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.430176 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 838/1668] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:45 2022] POST /identity/v3/users => generated 281 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:45.430176 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b216d75-74b0-42f5-9cc5-3c3426cd4d95 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.430176 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b216d75-74b0-42f5-9cc5-3c3426cd4d95 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.430176 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b216d75-74b0-42f5-9cc5-3c3426cd4d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.441511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97169b-d2dd-4726-ae4e-afd3575cd90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.442185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97169b-d2dd-4726-ae4e-afd3575cd90d admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.442721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97169b-d2dd-4726-ae4e-afd3575cd90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.442721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97169b-d2dd-4726-ae4e-afd3575cd90d admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.443573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97169b-d2dd-4726-ae4e-afd3575cd90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.445609 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97169b-d2dd-4726-ae4e-afd3575cd90d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.461828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 831/1669] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:45.462333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97169b-d2dd-4726-ae4e-afd3575cd90d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.478298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97169b-d2dd-4726-ae4e-afd3575cd90d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.478805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0b216d75-74b0-42f5-9cc5-3c3426cd4d95 None None] MFA Rules not processed for user `bce78f404c874defb2dda264b2fcfd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:45.480407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0b216d75-74b0-42f5-9cc5-3c3426cd4d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:45.483716 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cf006-ce86-49d7-adb6-49e0a53197cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.484336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cf006-ce86-49d7-adb6-49e0a53197cf admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.484614 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cf006-ce86-49d7-adb6-49e0a53197cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.484881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cf006-ce86-49d7-adb6-49e0a53197cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.485559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cf006-ce86-49d7-adb6-49e0a53197cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.488073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cf006-ce86-49d7-adb6-49e0a53197cf admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.501345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 832/1670] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:45.506271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cf006-ce86-49d7-adb6-49e0a53197cf admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.516889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cf006-ce86-49d7-adb6-49e0a53197cf admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.521669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e105358-1489-4eac-8c95-720f8d03a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.522329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105358-1489-4eac-8c95-720f8d03a15d admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.522605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105358-1489-4eac-8c95-720f8d03a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.522937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105358-1489-4eac-8c95-720f8d03a15d admin admin] PATH_INFO: `/v3/projects/f7410972d09142439c888d8affb4df3c/users/65b1823de27443e0abdbb2b404127647/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.540025 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e105358-1489-4eac-8c95-720f8d03a15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7410972d09142439c888d8affb4df3c, user_id=65b1823de27443e0abdbb2b404127647, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.542730 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e105358-1489-4eac-8c95-720f8d03a15d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.566612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 833/1671] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:45 2022] PUT /identity/v3/projects/f7410972d09142439c888d8affb4df3c/users/65b1823de27443e0abdbb2b404127647/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:45.568128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e105358-1489-4eac-8c95-720f8d03a15d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.577846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:45.618327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 839/1672] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:45.620656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2854577-3963-41cd-849b-629f91860f9c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.621194 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2854577-3963-41cd-849b-629f91860f9c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.622263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2854577-3963-41cd-849b-629f91860f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.636173 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:45.663968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e2854577-3963-41cd-849b-629f91860f9c None None] MFA Rules not processed for user `65b1823de27443e0abdbb2b404127647`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:45.665862 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e2854577-3963-41cd-849b-629f91860f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:45.673987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e105358-1489-4eac-8c95-720f8d03a15d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.679671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6177b4-c082-4c67-b342-b3d6bcad926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.680281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6177b4-c082-4c67-b342-b3d6bcad926e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.680588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6177b4-c082-4c67-b342-b3d6bcad926e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.680820 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6177b4-c082-4c67-b342-b3d6bcad926e admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.681691 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6177b4-c082-4c67-b342-b3d6bcad926e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.683211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6177b4-c082-4c67-b342-b3d6bcad926e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.695570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 834/1673] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:45.696772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6177b4-c082-4c67-b342-b3d6bcad926e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.698583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ba6177b4-c082-4c67-b342-b3d6bcad926e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:45.748038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 840/1674] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:45.748966 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2854577-3963-41cd-849b-629f91860f9c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.764298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2854577-3963-41cd-849b-629f91860f9c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.772405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81032aa1-e7fe-4716-bf40-fbc1d4d9086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.773215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81032aa1-e7fe-4716-bf40-fbc1d4d9086d admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.773593 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81032aa1-e7fe-4716-bf40-fbc1d4d9086d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.774113 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81032aa1-e7fe-4716-bf40-fbc1d4d9086d admin admin] PATH_INFO: `/v3/projects/7a59eeadf9a94bf79d233aac854008cc/users/644a4c64cc7c4a82be5036f0639343f2/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.785875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6177b4-c082-4c67-b342-b3d6bcad926e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.792240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcdab0-6a7f-452f-b1f7-5d1bd3af60ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.792684 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81032aa1-e7fe-4716-bf40-fbc1d4d9086d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a59eeadf9a94bf79d233aac854008cc, user_id=644a4c64cc7c4a82be5036f0639343f2, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.792868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcdab0-6a7f-452f-b1f7-5d1bd3af60ea service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.793179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcdab0-6a7f-452f-b1f7-5d1bd3af60ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.793478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcdab0-6a7f-452f-b1f7-5d1bd3af60ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.797242 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81032aa1-e7fe-4716-bf40-fbc1d4d9086d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.817203 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 841/1675] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:45 2022] PUT /identity/v3/projects/7a59eeadf9a94bf79d233aac854008cc/users/644a4c64cc7c4a82be5036f0639343f2/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:45.818391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81032aa1-e7fe-4716-bf40-fbc1d4d9086d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:45.940200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81032aa1-e7fe-4716-bf40-fbc1d4d9086d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:45.955287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f0233-2b66-4335-8847-5c90d37f68a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:45.956884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f0233-2b66-4335-8847-5c90d37f68a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:45.957881 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f0233-2b66-4335-8847-5c90d37f68a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:45.958165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f0233-2b66-4335-8847-5c90d37f68a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:45.958817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f0233-2b66-4335-8847-5c90d37f68a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.960955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f0233-2b66-4335-8847-5c90d37f68a8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:45.967286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcdab0-6a7f-452f-b1f7-5d1bd3af60ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:45.970445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcdab0-6a7f-452f-b1f7-5d1bd3af60ea service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.006874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 835/1676] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:46.008145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcdab0-6a7f-452f-b1f7-5d1bd3af60ea service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.012767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 842/1677] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:45 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:46.012920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-38fcdab0-6a7f-452f-b1f7-5d1bd3af60ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.013033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b8ff-dcfd-483f-be16-7770b0f2685a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.021439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b8ff-dcfd-483f-be16-7770b0f2685a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.021769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b8ff-dcfd-483f-be16-7770b0f2685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.027040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcdab0-6a7f-452f-b1f7-5d1bd3af60ea service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.074553 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a0a4b8ff-dcfd-483f-be16-7770b0f2685a None None] MFA Rules not processed for user `644a4c64cc7c4a82be5036f0639343f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:46.076364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a0a4b8ff-dcfd-483f-be16-7770b0f2685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.098424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:46.145664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.146396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.146874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.147221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] PATH_INFO: `/v3/projects/c790f11557394303bb552922b138ad58` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.148588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c790f11557394303bb552922b138ad58)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.150959 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.171465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 843/1678] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:46.172634 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4b8ff-dcfd-483f-be16-7770b0f2685a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.189459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4b8ff-dcfd-483f-be16-7770b0f2685a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.191381 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:46.196456 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df2c1a-5ad2-400f-b8b3-de2ebc7f2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.197151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df2c1a-5ad2-400f-b8b3-de2ebc7f2556 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.197371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df2c1a-5ad2-400f-b8b3-de2ebc7f2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.204104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df2c1a-5ad2-400f-b8b3-de2ebc7f2556 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.204104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df2c1a-5ad2-400f-b8b3-de2ebc7f2556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.204104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df2c1a-5ad2-400f-b8b3-de2ebc7f2556 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.218851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c790f11557394303bb552922b138ad58', 'request_id': 'req-9bcfde80-b824-4824-911b-c7a4b3b3227e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.226628 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 844/1679] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:46 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:46.226628 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df2c1a-5ad2-400f-b8b3-de2ebc7f2556 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.230641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c790f11557394303bb552922b138ad58', 'request_id': 'req-9bcfde80-b824-4824-911b-c7a4b3b3227e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.234724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df2c1a-5ad2-400f-b8b3-de2ebc7f2556 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.237333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c790f11557394303bb552922b138ad58', 'request_id': 'req-9bcfde80-b824-4824-911b-c7a4b3b3227e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.248851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] The token cache is being invalidate because project c790f11557394303bb552922b138ad58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:46.249180 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.249833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.251330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 836/1680] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:46 2022] DELETE /identity/v3/projects/c790f11557394303bb552922b138ad58 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:46.252089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.254450 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.292808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.293495 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.293774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.294044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] PATH_INFO: `/v3/users/6b644c26073c483a813fcd6413be4457` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.295162 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b644c26073c483a813fcd6413be4457)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.297084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.311109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfde80-b824-4824-911b-c7a4b3b3227e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.314839 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa42652-00a0-4bb0-891a-1c6b223a6388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.315522 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa42652-00a0-4bb0-891a-1c6b223a6388 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.315722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa42652-00a0-4bb0-891a-1c6b223a6388 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.315999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa42652-00a0-4bb0-891a-1c6b223a6388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.317744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6fa42652-00a0-4bb0-891a-1c6b223a6388 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.344182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b644c26073c483a813fcd6413be4457'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.344886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b644c26073c483a813fcd6413be4457'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.352737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b644c26073c483a813fcd6413be4457'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.353468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b644c26073c483a813fcd6413be4457'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.366816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b644c26073c483a813fcd6413be4457'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.380421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa42652-00a0-4bb0-891a-1c6b223a6388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.382060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 845/1681] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:46 2022] DELETE /identity/v3/users/6b644c26073c483a813fcd6413be4457 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:46.382172 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa42652-00a0-4bb0-891a-1c6b223a6388 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.382676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.384013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.391141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 837/1682] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:46.391809 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa42652-00a0-4bb0-891a-1c6b223a6388 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.393685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6fa42652-00a0-4bb0-891a-1c6b223a6388 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.407081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa42652-00a0-4bb0-891a-1c6b223a6388 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.407245 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:46.451768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563ac3-be74-4224-bf18-545b65bc0339 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.456685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf597a-0027-4d07-af34-7d616a3157fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.457333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf597a-0027-4d07-af34-7d616a3157fd admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.457722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf597a-0027-4d07-af34-7d616a3157fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.458001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf597a-0027-4d07-af34-7d616a3157fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.458670 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf597a-0027-4d07-af34-7d616a3157fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.460257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf597a-0027-4d07-af34-7d616a3157fd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.466521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.467151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.467422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.467695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] PATH_INFO: `/v3/users/1e11dcd2b2b84465b0e4a1bbcac3d16c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.468835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e11dcd2b2b84465b0e4a1bbcac3d16c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.470501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 846/1683] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:46.470818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.472195 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59897f-d02f-4503-bded-e369c6125eed None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.472735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59897f-d02f-4503-bded-e369c6125eed None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.473027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59897f-d02f-4503-bded-e369c6125eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.477220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:46.493767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9b59897f-d02f-4503-bded-e369c6125eed None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:46.494989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9b59897f-d02f-4503-bded-e369c6125eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.503871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 847/1684] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:46.504649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59897f-d02f-4503-bded-e369c6125eed None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.506444 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9b59897f-d02f-4503-bded-e369c6125eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.519569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59897f-d02f-4503-bded-e369c6125eed None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.524156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.524316 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e11dcd2b2b84465b0e4a1bbcac3d16c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.524769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.525064 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.525335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] PATH_INFO: `/v3/users/644a4c64cc7c4a82be5036f0639343f2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.526448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=644a4c64cc7c4a82be5036f0639343f2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.528352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.532596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e11dcd2b2b84465b0e4a1bbcac3d16c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.537792 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e11dcd2b2b84465b0e4a1bbcac3d16c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.554666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e11dcd2b2b84465b0e4a1bbcac3d16c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.562681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e11dcd2b2b84465b0e4a1bbcac3d16c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.569887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 838/1685] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:46 2022] DELETE /identity/v3/users/1e11dcd2b2b84465b0e4a1bbcac3d16c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:46.570775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.572129 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.589299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644a4c64cc7c4a82be5036f0639343f2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.590022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644a4c64cc7c4a82be5036f0639343f2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.599643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644a4c64cc7c4a82be5036f0639343f2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.600397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644a4c64cc7c4a82be5036f0639343f2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.616868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644a4c64cc7c4a82be5036f0639343f2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:46.633266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 848/1686] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:46 2022] DELETE /identity/v3/users/644a4c64cc7c4a82be5036f0639343f2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:46.636451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.636451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.652175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5407eb4-8ce2-4d19-b79d-beec90d5612f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.706082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc6e66-9794-44ae-b5b8-b39444c4da5c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.712165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de7e26-57ff-4452-b97f-390eaf862fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.712780 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de7e26-57ff-4452-b97f-390eaf862fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.713089 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de7e26-57ff-4452-b97f-390eaf862fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.713364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de7e26-57ff-4452-b97f-390eaf862fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.715201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-46de7e26-57ff-4452-b97f-390eaf862fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.726646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a2036-10f4-4adf-817b-c6dc590b2dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.727382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2036-10f4-4adf-817b-c6dc590b2dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.727579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2036-10f4-4adf-817b-c6dc590b2dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.727847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2036-10f4-4adf-817b-c6dc590b2dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.730861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a2036-10f4-4adf-817b-c6dc590b2dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.730861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a2036-10f4-4adf-817b-c6dc590b2dc7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.769265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 839/1687] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:46.771598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e703b-a95a-447b-a1df-d4f8d486d764 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.772564 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e703b-a95a-447b-a1df-d4f8d486d764 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.772564 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e703b-a95a-447b-a1df-d4f8d486d764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.774096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:46.803595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-499e703b-a95a-447b-a1df-d4f8d486d764 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:46.804721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-499e703b-a95a-447b-a1df-d4f8d486d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.812365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de7e26-57ff-4452-b97f-390eaf862fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.813968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de7e26-57ff-4452-b97f-390eaf862fb9 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.815282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 840/1688] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:46.816378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e703b-a95a-447b-a1df-d4f8d486d764 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.819419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-499e703b-a95a-447b-a1df-d4f8d486d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.825080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 849/1689] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:46.827168 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de7e26-57ff-4452-b97f-390eaf862fb9 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:46.828933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-46de7e26-57ff-4452-b97f-390eaf862fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:46.836340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e703b-a95a-447b-a1df-d4f8d486d764 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.843995 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d96455-73cb-46cc-a2c3-be282008048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.844833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96455-73cb-46cc-a2c3-be282008048f admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.844951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de7e26-57ff-4452-b97f-390eaf862fb9 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:46.845870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96455-73cb-46cc-a2c3-be282008048f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.845870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96455-73cb-46cc-a2c3-be282008048f admin admin] PATH_INFO: `/v3/projects/cec931318abd46d482ab65247c841da7/users/9ce632d9d4494437bf5aaec74548126e/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.850607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3073af3-b239-4204-aeb1-17d50b330aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:46.852577 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3073af3-b239-4204-aeb1-17d50b330aec service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.852956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3073af3-b239-4204-aeb1-17d50b330aec service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.853511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3073af3-b239-4204-aeb1-17d50b330aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.865757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3073af3-b239-4204-aeb1-17d50b330aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.868806 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3073af3-b239-4204-aeb1-17d50b330aec service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.871713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d96455-73cb-46cc-a2c3-be282008048f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec931318abd46d482ab65247c841da7, user_id=9ce632d9d4494437bf5aaec74548126e, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:46.875379 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d96455-73cb-46cc-a2c3-be282008048f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:46.883904 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 850/1690] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:46.888330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:46.905558 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 841/1691] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:46 2022] PUT /identity/v3/projects/cec931318abd46d482ab65247c841da7/users/9ce632d9d4494437bf5aaec74548126e/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:46.907137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8031bc-bd52-4f9f-a1e8-2825ff427770 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:46.907579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8031bc-bd52-4f9f-a1e8-2825ff427770 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:46.907908 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8031bc-bd52-4f9f-a1e8-2825ff427770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:46.938549 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-9b8031bc-bd52-4f9f-a1e8-2825ff427770 None None] MFA Rules not processed for user `9ce632d9d4494437bf5aaec74548126e`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:46.939834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9b8031bc-bd52-4f9f-a1e8-2825ff427770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:47.058273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 851/1692] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:27:47.062432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d96455-73cb-46cc-a2c3-be282008048f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.147610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d96455-73cb-46cc-a2c3-be282008048f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:47.152384 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8f540-09b9-4218-8755-afcd0ed91abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:47.152991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8f540-09b9-4218-8755-afcd0ed91abf admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.153300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8f540-09b9-4218-8755-afcd0ed91abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.153562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8f540-09b9-4218-8755-afcd0ed91abf admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.154202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8f540-09b9-4218-8755-afcd0ed91abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:47.156310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8f540-09b9-4218-8755-afcd0ed91abf admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:47.190082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 842/1693] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:47 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:27:47.194323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8031bc-bd52-4f9f-a1e8-2825ff427770 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.206972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8031bc-bd52-4f9f-a1e8-2825ff427770 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:47.300866 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8f540-09b9-4218-8755-afcd0ed91abf admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.302666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c3d8f540-09b9-4218-8755-afcd0ed91abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:47.307575 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614db13-7070-432a-adc6-1336a9e4b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:47.308199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614db13-7070-432a-adc6-1336a9e4b11b admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.308475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614db13-7070-432a-adc6-1336a9e4b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.308746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614db13-7070-432a-adc6-1336a9e4b11b admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.309614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614db13-7070-432a-adc6-1336a9e4b11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:47.311545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614db13-7070-432a-adc6-1336a9e4b11b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:47.325455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8f540-09b9-4218-8755-afcd0ed91abf admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:47.339341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:47.340139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.343286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.343415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 852/1694] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:47 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:27:47.343498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] PATH_INFO: `/v3/projects/9af64847d97e478ba7421cf709144426` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.343498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af64847d97e478ba7421cf709144426)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:47.345704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:47.353995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614db13-7070-432a-adc6-1336a9e4b11b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.369247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614db13-7070-432a-adc6-1336a9e4b11b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:47.375021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeda11-df14-4bbf-a541-604ecf6b9568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:47.375641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeda11-df14-4bbf-a541-604ecf6b9568 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.375920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeda11-df14-4bbf-a541-604ecf6b9568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.376314 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeda11-df14-4bbf-a541-604ecf6b9568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.377792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeda11-df14-4bbf-a541-604ecf6b9568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:47.379648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeda11-df14-4bbf-a541-604ecf6b9568 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:47.393101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 853/1695] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:47.396147 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeda11-df14-4bbf-a541-604ecf6b9568 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.406556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeda11-df14-4bbf-a541-604ecf6b9568 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:47.432476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:47.441094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af64847d97e478ba7421cf709144426', 'request_id': 'req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.452121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af64847d97e478ba7421cf709144426', 'request_id': 'req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.462453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af64847d97e478ba7421cf709144426', 'request_id': 'req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.481272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] The token cache is being invalidate because project 9af64847d97e478ba7421cf709144426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:47.481566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.485980 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-fa5af484-0c3e-418a-ad12-1f2f1ae3f2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.495639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 843/1696] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:47 2022] DELETE /identity/v3/projects/9af64847d97e478ba7421cf709144426 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:47.497728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b6780-6c70-4eb2-ac24-a7abd8fe4004 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.498039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b6780-6c70-4eb2-ac24-a7abd8fe4004 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.498405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b6780-6c70-4eb2-ac24-a7abd8fe4004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.514247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a29b33-1bb3-42c3-96d2-4fe5fd3187da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:47.516241 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a29b33-1bb3-42c3-96d2-4fe5fd3187da admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.516529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a29b33-1bb3-42c3-96d2-4fe5fd3187da admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.516809 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a29b33-1bb3-42c3-96d2-4fe5fd3187da admin admin] PATH_INFO: `/v3/projects/6cc06dccbc4e488197eb0849f6ed44aa/users/7e23317d03b34f908d92cdde065a57a6/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.525919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-013b6780-6c70-4eb2-ac24-a7abd8fe4004 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:47.527472 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-013b6780-6c70-4eb2-ac24-a7abd8fe4004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:47.538229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a29b33-1bb3-42c3-96d2-4fe5fd3187da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc06dccbc4e488197eb0849f6ed44aa, user_id=7e23317d03b34f908d92cdde065a57a6, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:47.540373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 844/1697] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:47.541779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b6780-6c70-4eb2-ac24-a7abd8fe4004 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.542803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a29b33-1bb3-42c3-96d2-4fe5fd3187da admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:47.544134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-013b6780-6c70-4eb2-ac24-a7abd8fe4004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:47.562738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b6780-6c70-4eb2-ac24-a7abd8fe4004 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:47.565878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 854/1698] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:47 2022] PUT /identity/v3/projects/6cc06dccbc4e488197eb0849f6ed44aa/users/7e23317d03b34f908d92cdde065a57a6/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:47.567476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f71fce-5665-4873-aab0-51d3e55dfa66 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.567751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f71fce-5665-4873-aab0-51d3e55dfa66 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.568065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f71fce-5665-4873-aab0-51d3e55dfa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.612231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d0f71fce-5665-4873-aab0-51d3e55dfa66 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:47.613548 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d0f71fce-5665-4873-aab0-51d3e55dfa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:47.653972 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:47.654703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.654988 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.655309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] PATH_INFO: `/v3/projects/33f3b2be9f82423895435391e354361a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.656656 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f3b2be9f82423895435391e354361a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:47.658474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:47.660666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:47.693568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 855/1699] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:47.694571 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f71fce-5665-4873-aab0-51d3e55dfa66 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.695940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d0f71fce-5665-4873-aab0-51d3e55dfa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:47.709899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f71fce-5665-4873-aab0-51d3e55dfa66 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:47.726655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f3b2be9f82423895435391e354361a', 'request_id': 'req-c82d23cc-98d8-4e28-95c2-742376f3c222'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.734732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f3b2be9f82423895435391e354361a', 'request_id': 'req-c82d23cc-98d8-4e28-95c2-742376f3c222'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.741576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f3b2be9f82423895435391e354361a', 'request_id': 'req-c82d23cc-98d8-4e28-95c2-742376f3c222'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.761477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] The token cache is being invalidate because project 33f3b2be9f82423895435391e354361a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:47.761671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.762559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.765652 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 845/1700] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:47 2022] DELETE /identity/v3/projects/33f3b2be9f82423895435391e354361a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:47.767457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.770258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:47.774944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e39f0-d6c2-4ab9-8555-07393250e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:47.776126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e39f0-d6c2-4ab9-8555-07393250e74a admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.776126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e39f0-d6c2-4ab9-8555-07393250e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.776126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e39f0-d6c2-4ab9-8555-07393250e74a admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.776707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e39f0-d6c2-4ab9-8555-07393250e74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:47.778332 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e39f0-d6c2-4ab9-8555-07393250e74a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:47.793152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 856/1701] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:47.794006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e39f0-d6c2-4ab9-8555-07393250e74a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.795840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dd6e39f0-d6c2-4ab9-8555-07393250e74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:47.806067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d23cc-98d8-4e28-95c2-742376f3c222 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:47.812445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:47.813465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.813745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.814018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] PATH_INFO: `/v3/projects/7a59eeadf9a94bf79d233aac854008cc` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.815814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e39f0-d6c2-4ab9-8555-07393250e74a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:47.815943 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a59eeadf9a94bf79d233aac854008cc)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:47.818065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:47.828940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a2e3e-f7f0-4506-aaea-971513402d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:47.830099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a2e3e-f7f0-4506-aaea-971513402d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.830407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a2e3e-f7f0-4506-aaea-971513402d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.830986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a2e3e-f7f0-4506-aaea-971513402d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.831757 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a2e3e-f7f0-4506-aaea-971513402d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:47.832067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a2e3e-f7f0-4506-aaea-971513402d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:47.834104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a2e3e-f7f0-4506-aaea-971513402d15 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:47.849855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 857/1702] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:47.850548 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a2e3e-f7f0-4506-aaea-971513402d15 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.852552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a50a2e3e-f7f0-4506-aaea-971513402d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:47.868357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a2e3e-f7f0-4506-aaea-971513402d15 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:47.885612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a59eeadf9a94bf79d233aac854008cc', 'request_id': 'req-2df79760-e5b9-4342-9c08-0c1d6bc48eae'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.894079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a59eeadf9a94bf79d233aac854008cc', 'request_id': 'req-2df79760-e5b9-4342-9c08-0c1d6bc48eae'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.907009 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a59eeadf9a94bf79d233aac854008cc', 'request_id': 'req-2df79760-e5b9-4342-9c08-0c1d6bc48eae'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.911128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:47.926666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] The token cache is being invalidate because project 7a59eeadf9a94bf79d233aac854008cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:47.927038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.927791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:47.929690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 846/1703] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:47 2022] DELETE /identity/v3/projects/7a59eeadf9a94bf79d233aac854008cc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:47.930602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:47.933238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:47.952094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:47.952733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:47.953023 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:47.953322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] PATH_INFO: `/v3/users/bce78f404c874defb2dda264b2fcfd0e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:47.954465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce78f404c874defb2dda264b2fcfd0e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:47.957022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:48.028419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce78f404c874defb2dda264b2fcfd0e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:48.029039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce78f404c874defb2dda264b2fcfd0e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:48.030988 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df79760-e5b9-4342-9c08-0c1d6bc48eae admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:48.037296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce78f404c874defb2dda264b2fcfd0e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:48.038104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce78f404c874defb2dda264b2fcfd0e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:48.039574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c5fb2-6d22-4609-a07c-423e8c30743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:48.040814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c5fb2-6d22-4609-a07c-423e8c30743a admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.041144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c5fb2-6d22-4609-a07c-423e8c30743a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.041477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c5fb2-6d22-4609-a07c-423e8c30743a admin admin] PATH_INFO: `/v3/projects/6cc06dccbc4e488197eb0849f6ed44aa/users/7e23317d03b34f908d92cdde065a57a6/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.045711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c5fb2-6d22-4609-a07c-423e8c30743a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc06dccbc4e488197eb0849f6ed44aa, user_id=7e23317d03b34f908d92cdde065a57a6, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:48.049735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c5fb2-6d22-4609-a07c-423e8c30743a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:48.052584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a62e9b17-5d0c-4343-8e30-2f15691d0974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce78f404c874defb2dda264b2fcfd0e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:48.065711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 847/1704] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:47 2022] PUT /identity/v3/projects/6cc06dccbc4e488197eb0849f6ed44aa/users/7e23317d03b34f908d92cdde065a57a6/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:48.070083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c5fb2-6d22-4609-a07c-423e8c30743a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:48.078331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6d8c5fb2-6d22-4609-a07c-423e8c30743a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:48.079974 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 858/1705] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:47 2022] DELETE /identity/v3/users/bce78f404c874defb2dda264b2fcfd0e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:48.082034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a8bc-92f8-44b0-8396-f76a748af0b8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.082562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a8bc-92f8-44b0-8396-f76a748af0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.083043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a8bc-92f8-44b0-8396-f76a748af0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.095209 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:48.126542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6851a8bc-92f8-44b0-8396-f76a748af0b8 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:48.128019 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6851a8bc-92f8-44b0-8396-f76a748af0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:48.182483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c5fb2-6d22-4609-a07c-423e8c30743a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:48.286948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 859/1706] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:48.288591 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a000b-5544-4524-9996-9baa66c5ef56 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.289056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a000b-5544-4524-9996-9baa66c5ef56 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.289365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a000b-5544-4524-9996-9baa66c5ef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.318502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83294c-9c12-40ea-940b-61b5d6ac908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:48.319476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83294c-9c12-40ea-940b-61b5d6ac908e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.319818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83294c-9c12-40ea-940b-61b5d6ac908e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.320272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83294c-9c12-40ea-940b-61b5d6ac908e admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.321155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83294c-9c12-40ea-940b-61b5d6ac908e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:48.324114 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83294c-9c12-40ea-940b-61b5d6ac908e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:48.341517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cc6a000b-5544-4524-9996-9baa66c5ef56 None None] MFA Rules not processed for user `7e23317d03b34f908d92cdde065a57a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:48.343633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cc6a000b-5544-4524-9996-9baa66c5ef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:48.365815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 848/1707] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:48 2022] POST /identity/v3/projects => generated 365 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:48.367542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e043-a75b-4059-9f26-7c635cecc030 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.367808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e043-a75b-4059-9f26-7c635cecc030 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.368184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e043-a75b-4059-9f26-7c635cecc030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.399975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:48.407540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cd70e043-a75b-4059-9f26-7c635cecc030 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:48.409783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cd70e043-a75b-4059-9f26-7c635cecc030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:48.439543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 860/1708] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:48.446143 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a000b-5544-4524-9996-9baa66c5ef56 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:48.462275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a000b-5544-4524-9996-9baa66c5ef56 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:48.500550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 849/1709] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:48.502103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70e043-a75b-4059-9f26-7c635cecc030 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:48.504687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cd70e043-a75b-4059-9f26-7c635cecc030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:48.561481 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6df09-b990-4036-8d54-71bd536faa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:48.564396 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6df09-b990-4036-8d54-71bd536faa42 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.564912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6df09-b990-4036-8d54-71bd536faa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.565515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6df09-b990-4036-8d54-71bd536faa42 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.566387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6df09-b990-4036-8d54-71bd536faa42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:48.568732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6df09-b990-4036-8d54-71bd536faa42 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:48.574688 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:48.597252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70e043-a75b-4059-9f26-7c635cecc030 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:48.601895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ce3a4-e7ac-40c6-b996-4a9d483bb977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:48.602646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ce3a4-e7ac-40c6-b996-4a9d483bb977 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.603008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ce3a4-e7ac-40c6-b996-4a9d483bb977 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.603429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ce3a4-e7ac-40c6-b996-4a9d483bb977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.605333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 861/1710] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:48 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:48.605460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-299ce3a4-e7ac-40c6-b996-4a9d483bb977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:48.606609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6df09-b990-4036-8d54-71bd536faa42 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:48.623490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6df09-b990-4036-8d54-71bd536faa42 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:48.631333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e809836-7468-46ba-9415-f4c2f269428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:48.632253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e809836-7468-46ba-9415-f4c2f269428e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.633112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e809836-7468-46ba-9415-f4c2f269428e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.633959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e809836-7468-46ba-9415-f4c2f269428e admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.634737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e809836-7468-46ba-9415-f4c2f269428e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:48.635407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e809836-7468-46ba-9415-f4c2f269428e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:48.637592 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e809836-7468-46ba-9415-f4c2f269428e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:48.659460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 862/1711] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:48.659460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e809836-7468-46ba-9415-f4c2f269428e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:48.673902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e809836-7468-46ba-9415-f4c2f269428e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:48.681451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ab775-e2b6-4202-9df0-3d955da471c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:48.682282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ab775-e2b6-4202-9df0-3d955da471c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.683590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ab775-e2b6-4202-9df0-3d955da471c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.684214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ab775-e2b6-4202-9df0-3d955da471c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.685297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ab775-e2b6-4202-9df0-3d955da471c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:48.687446 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ab775-e2b6-4202-9df0-3d955da471c6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:48.701142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ce3a4-e7ac-40c6-b996-4a9d483bb977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:48.702776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ce3a4-e7ac-40c6-b996-4a9d483bb977 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:48.706891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 863/1712] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:48.706891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ab775-e2b6-4202-9df0-3d955da471c6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:48.723001 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 850/1713] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:48.725761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ab775-e2b6-4202-9df0-3d955da471c6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:48.727671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ce3a4-e7ac-40c6-b996-4a9d483bb977 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:48.736186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b450e6-d782-4ca0-8a2a-62211f20a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:48.737779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b450e6-d782-4ca0-8a2a-62211f20a71d admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.739032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b450e6-d782-4ca0-8a2a-62211f20a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.739781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b450e6-d782-4ca0-8a2a-62211f20a71d admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.741962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b450e6-d782-4ca0-8a2a-62211f20a71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:48.749135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ce3a4-e7ac-40c6-b996-4a9d483bb977 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:48.752898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b450e6-d782-4ca0-8a2a-62211f20a71d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:48.755556 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9432e-25cc-4282-9947-cb89d6c88c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:48.756474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9432e-25cc-4282-9947-cb89d6c88c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.756474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9432e-25cc-4282-9947-cb89d6c88c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.756819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9432e-25cc-4282-9947-cb89d6c88c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.757767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9432e-25cc-4282-9947-cb89d6c88c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:48.759488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9432e-25cc-4282-9947-cb89d6c88c3c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:48.772948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 851/1714] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:48.777697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9432e-25cc-4282-9947-cb89d6c88c3c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:48.797266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9432e-25cc-4282-9947-cb89d6c88c3c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:48.809445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c3e11-0b79-4c84-8c44-e22143e2fca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:48.813723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3e11-0b79-4c84-8c44-e22143e2fca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.817358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3e11-0b79-4c84-8c44-e22143e2fca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.821859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 864/1715] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:48 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:48.824071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b450e6-d782-4ca0-8a2a-62211f20a71d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:48.834974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3e11-0b79-4c84-8c44-e22143e2fca9 admin admin] PATH_INFO: `/v3/projects/6eab87dc5836496ebda81be8bf276329/users/5c6074ee220f4cc9ad7a9fc0b0a33537/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.868728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c3e11-0b79-4c84-8c44-e22143e2fca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eab87dc5836496ebda81be8bf276329, user_id=5c6074ee220f4cc9ad7a9fc0b0a33537, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:48.875085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c3e11-0b79-4c84-8c44-e22143e2fca9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:48.922563 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 852/1716] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:48 2022] PUT /identity/v3/projects/6eab87dc5836496ebda81be8bf276329/users/5c6074ee220f4cc9ad7a9fc0b0a33537/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:48.923885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8eaec-afa3-4357-9f37-6e6f1662fe99 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:48.925246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8eaec-afa3-4357-9f37-6e6f1662fe99 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:48.925246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8eaec-afa3-4357-9f37-6e6f1662fe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:48.959141 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b450e6-d782-4ca0-8a2a-62211f20a71d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:48.965936 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5ad8eaec-afa3-4357-9f37-6e6f1662fe99 None None] MFA Rules not processed for user `5c6074ee220f4cc9ad7a9fc0b0a33537`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:48.968718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5ad8eaec-afa3-4357-9f37-6e6f1662fe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:49.005419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:49.076393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac32780-7334-4f92-a3c8-04bde088b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:49.078084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac32780-7334-4f92-a3c8-04bde088b747 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.078593 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac32780-7334-4f92-a3c8-04bde088b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.079205 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac32780-7334-4f92-a3c8-04bde088b747 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.081177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac32780-7334-4f92-a3c8-04bde088b747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:49.084505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac32780-7334-4f92-a3c8-04bde088b747 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:49.157060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 865/1717] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:48 2022] POST /identity/v3/users => generated 292 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:27:49.160190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac32780-7334-4f92-a3c8-04bde088b747 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:49.169146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cac32780-7334-4f92-a3c8-04bde088b747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:49.174806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 853/1718] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:49.175777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8eaec-afa3-4357-9f37-6e6f1662fe99 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:49.199742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac32780-7334-4f92-a3c8-04bde088b747 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:49.202361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8eaec-afa3-4357-9f37-6e6f1662fe99 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:49.213141 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:49.214705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.214705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.214705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] PATH_INFO: `/v3/projects/f92bb47dbc094dbaa5cb521b0a8fe9ee` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.217478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92bb47dbc094dbaa5cb521b0a8fe9ee)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:49.217675 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce58ce-21a7-413a-abfe-7d5a29cc6c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:49.219504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce58ce-21a7-413a-abfe-7d5a29cc6c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.221979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:49.224095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce58ce-21a7-413a-abfe-7d5a29cc6c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.224585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce58ce-21a7-413a-abfe-7d5a29cc6c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.225910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce58ce-21a7-413a-abfe-7d5a29cc6c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:49.228886 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce58ce-21a7-413a-abfe-7d5a29cc6c49 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:49.264582 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 854/1719] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:49.266295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce58ce-21a7-413a-abfe-7d5a29cc6c49 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:49.295599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce58ce-21a7-413a-abfe-7d5a29cc6c49 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:49.303495 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92bb47dbc094dbaa5cb521b0a8fe9ee', 'request_id': 'req-53321d74-d49a-4e36-a107-3612557f1114'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:49.326000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92bb47dbc094dbaa5cb521b0a8fe9ee', 'request_id': 'req-53321d74-d49a-4e36-a107-3612557f1114'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:49.349785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92bb47dbc094dbaa5cb521b0a8fe9ee', 'request_id': 'req-53321d74-d49a-4e36-a107-3612557f1114'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:49.376372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] The token cache is being invalidate because project f92bb47dbc094dbaa5cb521b0a8fe9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:49.377987 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:49.380306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:49.383653 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 866/1720] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:49 2022] DELETE /identity/v3/projects/f92bb47dbc094dbaa5cb521b0a8fe9ee => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:49.384760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:49.388243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:49.396986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:49.470901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133b114-102a-4c4b-abad-2b576dbb347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:49.471893 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133b114-102a-4c4b-abad-2b576dbb347f admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.472213 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133b114-102a-4c4b-abad-2b576dbb347f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.472681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133b114-102a-4c4b-abad-2b576dbb347f admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.473355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133b114-102a-4c4b-abad-2b576dbb347f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:49.475686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133b114-102a-4c4b-abad-2b576dbb347f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:49.546747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 855/1721] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:49 2022] POST /identity/v3/projects => generated 365 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:49.549670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336804a-67d8-48fd-9e60-a502de7a7812 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.551404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336804a-67d8-48fd-9e60-a502de7a7812 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.551523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336804a-67d8-48fd-9e60-a502de7a7812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.561529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53321d74-d49a-4e36-a107-3612557f1114 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:49.632160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d336804a-67d8-48fd-9e60-a502de7a7812 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:49.635827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d336804a-67d8-48fd-9e60-a502de7a7812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:49.677368 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:49.710348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aac783-53e4-4199-af36-6ad62e1836d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:49.711004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aac783-53e4-4199-af36-6ad62e1836d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.711280 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aac783-53e4-4199-af36-6ad62e1836d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.711553 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aac783-53e4-4199-af36-6ad62e1836d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.712201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aac783-53e4-4199-af36-6ad62e1836d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:49.714207 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aac783-53e4-4199-af36-6ad62e1836d0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:49.729049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 867/1722] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:49.729698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aac783-53e4-4199-af36-6ad62e1836d0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:49.733700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-37aac783-53e4-4199-af36-6ad62e1836d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:49.750261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aac783-53e4-4199-af36-6ad62e1836d0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:49.750693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 856/1723] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:49.751772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336804a-67d8-48fd-9e60-a502de7a7812 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:49.766598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbef67-81b3-4ac5-af9d-5a7159988fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:49.767791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbef67-81b3-4ac5-af9d-5a7159988fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.768525 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbef67-81b3-4ac5-af9d-5a7159988fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.769738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbef67-81b3-4ac5-af9d-5a7159988fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.770653 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbef67-81b3-4ac5-af9d-5a7159988fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:49.770764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336804a-67d8-48fd-9e60-a502de7a7812 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:49.776154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a0999-5aae-425e-9336-8165fb6dec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:49.777084 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a0999-5aae-425e-9336-8165fb6dec5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.777936 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a0999-5aae-425e-9336-8165fb6dec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.777936 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a0999-5aae-425e-9336-8165fb6dec5f admin admin] PATH_INFO: `/v3/projects/e43b2b9a9d504692941fbc95bfa5a57c/users/c94c45c0d49d4f0fb188d5460bcab58b/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.779906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbef67-81b3-4ac5-af9d-5a7159988fb9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:49.796319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a0999-5aae-425e-9336-8165fb6dec5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43b2b9a9d504692941fbc95bfa5a57c, user_id=c94c45c0d49d4f0fb188d5460bcab58b, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:49.800760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a0999-5aae-425e-9336-8165fb6dec5f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:49.818484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 868/1724] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:49 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:49.820640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c937b-0e1c-4796-8fa0-a4c780ad39ad None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.821266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c937b-0e1c-4796-8fa0-a4c780ad39ad None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.821773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c937b-0e1c-4796-8fa0-a4c780ad39ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.825792 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 857/1725] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:49 2022] PUT /identity/v3/projects/e43b2b9a9d504692941fbc95bfa5a57c/users/c94c45c0d49d4f0fb188d5460bcab58b/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:49.826809 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a0999-5aae-425e-9336-8165fb6dec5f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:49.849438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-991c937b-0e1c-4796-8fa0-a4c780ad39ad None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:49.851272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-991c937b-0e1c-4796-8fa0-a4c780ad39ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:49.927702 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a0999-5aae-425e-9336-8165fb6dec5f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:49.939653 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316cd8b-e2f3-415b-9068-7bb82a348784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:49.940359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316cd8b-e2f3-415b-9068-7bb82a348784 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.940694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316cd8b-e2f3-415b-9068-7bb82a348784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.941359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316cd8b-e2f3-415b-9068-7bb82a348784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.941997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316cd8b-e2f3-415b-9068-7bb82a348784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:49.943607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316cd8b-e2f3-415b-9068-7bb82a348784 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:49.957868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 869/1726] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:49.960458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e39b-3ab1-4f6e-ba81-4f29066572b1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.961121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e39b-3ab1-4f6e-ba81-4f29066572b1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.961631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e39b-3ab1-4f6e-ba81-4f29066572b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.965240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 858/1727] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:49.966231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316cd8b-e2f3-415b-9068-7bb82a348784 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:49.978147 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316cd8b-e2f3-415b-9068-7bb82a348784 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:49.983132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ef0b0-03b6-4531-837a-a271aaa492f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:49.983740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ef0b0-03b6-4531-837a-a271aaa492f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:49.984007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ef0b0-03b6-4531-837a-a271aaa492f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:49.984264 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ef0b0-03b6-4531-837a-a271aaa492f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:49.985398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ef0b0-03b6-4531-837a-a271aaa492f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:49.985398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ef0b0-03b6-4531-837a-a271aaa492f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:49.987509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ef0b0-03b6-4531-837a-a271aaa492f8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:50.002124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 859/1728] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:50.003169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a2c0e39b-3ab1-4f6e-ba81-4f29066572b1 None None] MFA Rules not processed for user `c94c45c0d49d4f0fb188d5460bcab58b`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:50.005661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a2c0e39b-3ab1-4f6e-ba81-4f29066572b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:50.007610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ef0b0-03b6-4531-837a-a271aaa492f8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.018408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ef0b0-03b6-4531-837a-a271aaa492f8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.029518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f216db-2937-4fed-ba06-df06c8bc1373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.029988 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f216db-2937-4fed-ba06-df06c8bc1373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.030259 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f216db-2937-4fed-ba06-df06c8bc1373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.030583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f216db-2937-4fed-ba06-df06c8bc1373 admin admin] PATH_INFO: `/v3/projects/bb40f67a7c89411e8f0e6065a3914ff9/users/cb42d75784ca4ae3817ad8f0a5cffe60/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.063835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f216db-2937-4fed-ba06-df06c8bc1373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb40f67a7c89411e8f0e6065a3914ff9, user_id=cb42d75784ca4ae3817ad8f0a5cffe60, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:50.068901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f216db-2937-4fed-ba06-df06c8bc1373 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:50.089661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:50.110319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 860/1729] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:50 2022] PUT /identity/v3/projects/bb40f67a7c89411e8f0e6065a3914ff9/users/cb42d75784ca4ae3817ad8f0a5cffe60/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:50.113302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f216db-2937-4fed-ba06-df06c8bc1373 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.160096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 870/1730] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:50.161030 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0e39b-3ab1-4f6e-ba81-4f29066572b1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.173129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0e39b-3ab1-4f6e-ba81-4f29066572b1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.212186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f216db-2937-4fed-ba06-df06c8bc1373 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.217131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149d3b3-4617-4060-b7e1-82c06b2155ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.217752 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d3b3-4617-4060-b7e1-82c06b2155ae admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.218027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d3b3-4617-4060-b7e1-82c06b2155ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.218297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d3b3-4617-4060-b7e1-82c06b2155ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.218939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149d3b3-4617-4060-b7e1-82c06b2155ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:50.221094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149d3b3-4617-4060-b7e1-82c06b2155ae admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:50.258366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 861/1731] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:50 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:50.258366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149d3b3-4617-4060-b7e1-82c06b2155ae admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.259515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:50.270131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4ba86-3684-4cbb-bb5f-cf677b701acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.271758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4ba86-3684-4cbb-bb5f-cf677b701acc admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.272188 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4ba86-3684-4cbb-bb5f-cf677b701acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.272563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4ba86-3684-4cbb-bb5f-cf677b701acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.273370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4ba86-3684-4cbb-bb5f-cf677b701acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:50.275286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4ba86-3684-4cbb-bb5f-cf677b701acc admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:50.292029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 871/1732] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:50.292029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4ba86-3684-4cbb-bb5f-cf677b701acc admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.305364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4ba86-3684-4cbb-bb5f-cf677b701acc admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.362975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149d3b3-4617-4060-b7e1-82c06b2155ae admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.368486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaec8f-2d1e-4d5f-9b7f-646ce51a3dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.369343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaec8f-2d1e-4d5f-9b7f-646ce51a3dfd admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.369803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaec8f-2d1e-4d5f-9b7f-646ce51a3dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.370375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaec8f-2d1e-4d5f-9b7f-646ce51a3dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.371452 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdaec8f-2d1e-4d5f-9b7f-646ce51a3dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:50.373666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdaec8f-2d1e-4d5f-9b7f-646ce51a3dfd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:50.380248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a862b3-bf12-441f-9d69-0031094f128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.381027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a862b3-bf12-441f-9d69-0031094f128e admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.381466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a862b3-bf12-441f-9d69-0031094f128e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.381742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a862b3-bf12-441f-9d69-0031094f128e admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.382533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a862b3-bf12-441f-9d69-0031094f128e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:50.384789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a862b3-bf12-441f-9d69-0031094f128e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:50.412884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 862/1733] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:50 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:50.413998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaec8f-2d1e-4d5f-9b7f-646ce51a3dfd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.417674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 872/1734] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:50 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:50.418642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a862b3-bf12-441f-9d69-0031094f128e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.435318 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a862b3-bf12-441f-9d69-0031094f128e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.530633 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaec8f-2d1e-4d5f-9b7f-646ce51a3dfd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.547141 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f55b5-ddb9-4bdd-bcfa-c0c93c43dd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.547793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f55b5-ddb9-4bdd-bcfa-c0c93c43dd37 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.548171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f55b5-ddb9-4bdd-bcfa-c0c93c43dd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.549859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f55b5-ddb9-4bdd-bcfa-c0c93c43dd37 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.550853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f55b5-ddb9-4bdd-bcfa-c0c93c43dd37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:50.553746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f55b5-ddb9-4bdd-bcfa-c0c93c43dd37 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:50.570973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488c2d5-ee11-4135-89fa-41fd1c50268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.573237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488c2d5-ee11-4135-89fa-41fd1c50268e admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.574877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488c2d5-ee11-4135-89fa-41fd1c50268e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.576251 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488c2d5-ee11-4135-89fa-41fd1c50268e admin admin] PATH_INFO: `/v3/projects/bb40f67a7c89411e8f0e6065a3914ff9/users/cb42d75784ca4ae3817ad8f0a5cffe60/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.584091 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488c2d5-ee11-4135-89fa-41fd1c50268e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb40f67a7c89411e8f0e6065a3914ff9, user_id=cb42d75784ca4ae3817ad8f0a5cffe60, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:50.586920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488c2d5-ee11-4135-89fa-41fd1c50268e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:50.595538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 873/1735] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:50 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:50.598617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f55b5-ddb9-4bdd-bcfa-c0c93c43dd37 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.619442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f55b5-ddb9-4bdd-bcfa-c0c93c43dd37 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.634635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 863/1736] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:50 2022] PUT /identity/v3/projects/bb40f67a7c89411e8f0e6065a3914ff9/users/cb42d75784ca4ae3817ad8f0a5cffe60/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:50.634635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488c2d5-ee11-4135-89fa-41fd1c50268e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.640302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:50.734788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72262f-da9f-48ed-b95b-b840d0de89b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.734788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72262f-da9f-48ed-b95b-b840d0de89b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.734788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72262f-da9f-48ed-b95b-b840d0de89b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.734788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72262f-da9f-48ed-b95b-b840d0de89b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.735151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72262f-da9f-48ed-b95b-b840d0de89b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:50.735151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72262f-da9f-48ed-b95b-b840d0de89b0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:50.754588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 874/1737] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:50.754588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e14b4e-eec0-4a6d-a3c5-98b7f0921327 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.754588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e14b4e-eec0-4a6d-a3c5-98b7f0921327 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.754588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e14b4e-eec0-4a6d-a3c5-98b7f0921327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.769716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:50.801342 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-06e14b4e-eec0-4a6d-a3c5-98b7f0921327 None None] MFA Rules not processed for user `cb42d75784ca4ae3817ad8f0a5cffe60`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:50.802805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-06e14b4e-eec0-4a6d-a3c5-98b7f0921327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:50.803932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488c2d5-ee11-4135-89fa-41fd1c50268e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.816871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c27157-0358-4aa0-ac0a-b62ac73f27aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.817533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c27157-0358-4aa0-ac0a-b62ac73f27aa admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.817807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c27157-0358-4aa0-ac0a-b62ac73f27aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.818074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c27157-0358-4aa0-ac0a-b62ac73f27aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.818881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c27157-0358-4aa0-ac0a-b62ac73f27aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:50.821237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c27157-0358-4aa0-ac0a-b62ac73f27aa admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:50.857913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 864/1738] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:50.858909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c27157-0358-4aa0-ac0a-b62ac73f27aa admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.861209 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-06c27157-0358-4aa0-ac0a-b62ac73f27aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:50.937677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c27157-0358-4aa0-ac0a-b62ac73f27aa admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.944904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a886a-0441-4f5e-a000-3735b64da5fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.945753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a886a-0441-4f5e-a000-3735b64da5fa service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.946321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a886a-0441-4f5e-a000-3735b64da5fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.946895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a886a-0441-4f5e-a000-3735b64da5fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.948908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-537a886a-0441-4f5e-a000-3735b64da5fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:50.966756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 875/1739] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:50.968443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e14b4e-eec0-4a6d-a3c5-98b7f0921327 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:50.988596 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e14b4e-eec0-4a6d-a3c5-98b7f0921327 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:50.995210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3847-cc3b-4275-9aec-35dc3eab3ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:50.995827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3847-cc3b-4275-9aec-35dc3eab3ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:50.996225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3847-cc3b-4275-9aec-35dc3eab3ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:50.996501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3847-cc3b-4275-9aec-35dc3eab3ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:50.997194 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa3847-cc3b-4275-9aec-35dc3eab3ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:50.999006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa3847-cc3b-4275-9aec-35dc3eab3ed3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:51.019285 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 876/1740] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:51.020441 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3847-cc3b-4275-9aec-35dc3eab3ed3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:51.032067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3847-cc3b-4275-9aec-35dc3eab3ed3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:51.038188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a886a-0441-4f5e-a000-3735b64da5fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:51.039805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf856-8e1b-417b-a270-41698386c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:51.039963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a886a-0441-4f5e-a000-3735b64da5fa service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:51.040277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf856-8e1b-417b-a270-41698386c41c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:51.040559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf856-8e1b-417b-a270-41698386c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:51.040826 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf856-8e1b-417b-a270-41698386c41c admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:51.041512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf856-8e1b-417b-a270-41698386c41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:51.043228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf856-8e1b-417b-a270-41698386c41c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:51.053059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 865/1741] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:51.053745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a886a-0441-4f5e-a000-3735b64da5fa service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:51.056363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-537a886a-0441-4f5e-a000-3735b64da5fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:51.056492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 877/1742] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:51.057627 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf856-8e1b-417b-a270-41698386c41c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:51.071823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf856-8e1b-417b-a270-41698386c41c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:51.072294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a886a-0441-4f5e-a000-3735b64da5fa service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:51.076623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e900ca8-175f-44d8-9c13-0d9bcd4c3b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:51.077499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e900ca8-175f-44d8-9c13-0d9bcd4c3b2e service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:51.077643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfd2a9-ae4c-48b6-916d-0a07f10330ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:51.077981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e900ca8-175f-44d8-9c13-0d9bcd4c3b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:51.078401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e900ca8-175f-44d8-9c13-0d9bcd4c3b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:51.078543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd2a9-ae4c-48b6-916d-0a07f10330ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:51.078835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd2a9-ae4c-48b6-916d-0a07f10330ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:51.079108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfd2a9-ae4c-48b6-916d-0a07f10330ed admin admin] PATH_INFO: `/v3/projects/921e985dc16343659a83dd3d92f1acf0/users/3a806c6030c54d429212cf7b712febe5/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:51.091126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e900ca8-175f-44d8-9c13-0d9bcd4c3b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:51.093323 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e900ca8-175f-44d8-9c13-0d9bcd4c3b2e service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:51.100550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfd2a9-ae4c-48b6-916d-0a07f10330ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=921e985dc16343659a83dd3d92f1acf0, user_id=3a806c6030c54d429212cf7b712febe5, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:51.104079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfd2a9-ae4c-48b6-916d-0a07f10330ed admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:51.121806 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 866/1743] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:51.122774 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e900ca8-175f-44d8-9c13-0d9bcd4c3b2e service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:51.139329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 878/1744] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:51 2022] PUT /identity/v3/projects/921e985dc16343659a83dd3d92f1acf0/users/3a806c6030c54d429212cf7b712febe5/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:51.151536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c989d2-8bc7-4e86-9af5-bc042d078612 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:51.151536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c989d2-8bc7-4e86-9af5-bc042d078612 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:51.151536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c989d2-8bc7-4e86-9af5-bc042d078612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:51.152375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e900ca8-175f-44d8-9c13-0d9bcd4c3b2e service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:51.187081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d6c989d2-8bc7-4e86-9af5-bc042d078612 None None] MFA Rules not processed for user `3a806c6030c54d429212cf7b712febe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:51.191554 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d6c989d2-8bc7-4e86-9af5-bc042d078612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:51.289954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:51.336719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 879/1745] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:51.376725 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b93a3-d7fb-431b-b3a6-0cb3e8f7f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:51.377668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b93a3-d7fb-431b-b3a6-0cb3e8f7f487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:51.379565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b93a3-d7fb-431b-b3a6-0cb3e8f7f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:51.380411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b93a3-d7fb-431b-b3a6-0cb3e8f7f487 admin admin] PATH_INFO: `/v3/projects/1693b7ad4c894fdfb0e0c9fac03f682e/users/a1d49a57be314993b552519698786072/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:51.423644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b93a3-d7fb-431b-b3a6-0cb3e8f7f487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1693b7ad4c894fdfb0e0c9fac03f682e, user_id=a1d49a57be314993b552519698786072, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:51.426658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b93a3-d7fb-431b-b3a6-0cb3e8f7f487 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:51.492511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 867/1746] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:51 2022] PUT /identity/v3/projects/1693b7ad4c894fdfb0e0c9fac03f682e/users/a1d49a57be314993b552519698786072/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:51.505794 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5bad6-8aa9-4aca-a5bf-8022428f520d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:51.506081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5bad6-8aa9-4aca-a5bf-8022428f520d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:51.506355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5bad6-8aa9-4aca-a5bf-8022428f520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:51.546805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-02c5bad6-8aa9-4aca-a5bf-8022428f520d None None] MFA Rules not processed for user `a1d49a57be314993b552519698786072`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:51.549740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-02c5bad6-8aa9-4aca-a5bf-8022428f520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:51.600926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b93a3-d7fb-431b-b3a6-0cb3e8f7f487 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:51.616514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:51.732093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 880/1747] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:51.737662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5bad6-8aa9-4aca-a5bf-8022428f520d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:51.789325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b93a3-d7fb-431b-b3a6-0cb3e8f7f487 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:51.802396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdae10-e304-479e-a686-3ce7d2cbfe1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:51.803199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdae10-e304-479e-a686-3ce7d2cbfe1e service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:51.803598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdae10-e304-479e-a686-3ce7d2cbfe1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:51.804295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdae10-e304-479e-a686-3ce7d2cbfe1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:51.807395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b8cdae10-e304-479e-a686-3ce7d2cbfe1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:51.901424 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdae10-e304-479e-a686-3ce7d2cbfe1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:51.910189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdae10-e304-479e-a686-3ce7d2cbfe1e service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:51.933581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5bad6-8aa9-4aca-a5bf-8022428f520d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:51.937363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 868/1748] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:51.946251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f9e3-bb92-415a-9c40-1ad6e0fe22f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:51.948305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f9e3-bb92-415a-9c40-1ad6e0fe22f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:51.948595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f9e3-bb92-415a-9c40-1ad6e0fe22f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:51.951266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f9e3-bb92-415a-9c40-1ad6e0fe22f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:51.955947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182f9e3-bb92-415a-9c40-1ad6e0fe22f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:51.962250 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182f9e3-bb92-415a-9c40-1ad6e0fe22f4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:52.049801 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdae10-e304-479e-a686-3ce7d2cbfe1e service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:52.050377 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 881/1749] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:51 2022] POST /identity/v3/projects => generated 385 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:52.068847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdae10-e304-479e-a686-3ce7d2cbfe1e service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:52.169592 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f9e3-bb92-415a-9c40-1ad6e0fe22f4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:52.220538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9641aba-ff61-4cfc-8ff1-79e3cea8cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:52.221903 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9641aba-ff61-4cfc-8ff1-79e3cea8cfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:52.222162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9641aba-ff61-4cfc-8ff1-79e3cea8cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:52.222785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9641aba-ff61-4cfc-8ff1-79e3cea8cfa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:52.223752 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9641aba-ff61-4cfc-8ff1-79e3cea8cfa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:52.226572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9641aba-ff61-4cfc-8ff1-79e3cea8cfa9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:52.263892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 869/1750] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:52 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:27:52.267183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9641aba-ff61-4cfc-8ff1-79e3cea8cfa9 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:52.291645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9641aba-ff61-4cfc-8ff1-79e3cea8cfa9 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:52.305916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4ba22-e970-4075-8561-550afbb3158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:52.306474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f9e3-bb92-415a-9c40-1ad6e0fe22f4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:52.306589 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4ba22-e970-4075-8561-550afbb3158c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:52.306817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4ba22-e970-4075-8561-550afbb3158c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:52.307134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4ba22-e970-4075-8561-550afbb3158c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:52.307727 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4ba22-e970-4075-8561-550afbb3158c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:52.314366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4ba22-e970-4075-8561-550afbb3158c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:52.317280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:52.322562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec8c01-65ba-45d3-80c1-1e072bac08ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:52.327932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec8c01-65ba-45d3-80c1-1e072bac08ff service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:52.328324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec8c01-65ba-45d3-80c1-1e072bac08ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:52.330031 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec8c01-65ba-45d3-80c1-1e072bac08ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:52.345305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 870/1751] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:52.347239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4ba22-e970-4075-8561-550afbb3158c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:52.371646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4ba22-e970-4075-8561-550afbb3158c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:52.397162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a7cde-477f-4fe9-82fd-182060f1ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:52.397162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a7cde-477f-4fe9-82fd-182060f1ea4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:52.397162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a7cde-477f-4fe9-82fd-182060f1ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:52.397162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a7cde-477f-4fe9-82fd-182060f1ea4b admin admin] PATH_INFO: `/v3/projects/14ea91ce2fe14c2083a08eb3f95fad0b/users/544ff744cbf749d3b3a03807e6e34877/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:52.435516 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a7cde-477f-4fe9-82fd-182060f1ea4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ea91ce2fe14c2083a08eb3f95fad0b, user_id=544ff744cbf749d3b3a03807e6e34877, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:52.442757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a7cde-477f-4fe9-82fd-182060f1ea4b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:52.475985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec8c01-65ba-45d3-80c1-1e072bac08ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:52.479685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec8c01-65ba-45d3-80c1-1e072bac08ff service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:52.492661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 871/1752] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:52 2022] PUT /identity/v3/projects/14ea91ce2fe14c2083a08eb3f95fad0b/users/544ff744cbf749d3b3a03807e6e34877/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:52.494263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a7cde-477f-4fe9-82fd-182060f1ea4b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:52.500731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 882/1753] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:52.640391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a7cde-477f-4fe9-82fd-182060f1ea4b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:52.647047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ebfa6-291d-4781-bf1a-198e63f94c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:52.647682 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ebfa6-291d-4781-bf1a-198e63f94c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:52.647960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ebfa6-291d-4781-bf1a-198e63f94c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:52.648231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ebfa6-291d-4781-bf1a-198e63f94c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:52.648908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ebfa6-291d-4781-bf1a-198e63f94c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:52.651439 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ebfa6-291d-4781-bf1a-198e63f94c2c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:52.669180 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 872/1754] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:52.670997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec8c01-65ba-45d3-80c1-1e072bac08ff service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:52.678926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:52.685868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec8c01-65ba-45d3-80c1-1e072bac08ff service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:52.698954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e9c95-9d36-4d51-9892-d89e5421f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:52.701826 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e9c95-9d36-4d51-9892-d89e5421f1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:52.702113 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e9c95-9d36-4d51-9892-d89e5421f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:52.702389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e9c95-9d36-4d51-9892-d89e5421f1d6 admin admin] PATH_INFO: `/v3/projects/14ea91ce2fe14c2083a08eb3f95fad0b/users/544ff744cbf749d3b3a03807e6e34877/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:52.708373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e9c95-9d36-4d51-9892-d89e5421f1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ea91ce2fe14c2083a08eb3f95fad0b, user_id=544ff744cbf749d3b3a03807e6e34877, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:52.711260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e9c95-9d36-4d51-9892-d89e5421f1d6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:52.737124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 883/1755] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:52 2022] PUT /identity/v3/projects/14ea91ce2fe14c2083a08eb3f95fad0b/users/544ff744cbf749d3b3a03807e6e34877/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:52.749786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cd78e-cfb6-4ff4-bf55-51bb7ea85576 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:52.750294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cd78e-cfb6-4ff4-bf55-51bb7ea85576 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:52.750669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cd78e-cfb6-4ff4-bf55-51bb7ea85576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:52.831112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f14cd78e-cfb6-4ff4-bf55-51bb7ea85576 None None] MFA Rules not processed for user `544ff744cbf749d3b3a03807e6e34877`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:52.832403 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f14cd78e-cfb6-4ff4-bf55-51bb7ea85576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:53.011350 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 873/1756] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:53.030695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e9c95-9d36-4d51-9892-d89e5421f1d6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:53.106038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e9c95-9d36-4d51-9892-d89e5421f1d6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:53.110633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce384f-4278-476a-876d-3d7e788d3548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:53.111391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce384f-4278-476a-876d-3d7e788d3548 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:53.112821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce384f-4278-476a-876d-3d7e788d3548 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:53.113195 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce384f-4278-476a-876d-3d7e788d3548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:53.115308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0cce384f-4278-476a-876d-3d7e788d3548 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:53.216353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce384f-4278-476a-876d-3d7e788d3548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:53.219272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce384f-4278-476a-876d-3d7e788d3548 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:53.245793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 884/1757] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:53.283619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cd78e-cfb6-4ff4-bf55-51bb7ea85576 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:53.297939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cd78e-cfb6-4ff4-bf55-51bb7ea85576 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:53.303927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb47a8-0b19-4e8c-82d7-270700fc8bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:53.304683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb47a8-0b19-4e8c-82d7-270700fc8bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:53.304977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb47a8-0b19-4e8c-82d7-270700fc8bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:53.305290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb47a8-0b19-4e8c-82d7-270700fc8bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:53.367309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:53.382253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb47a8-0b19-4e8c-82d7-270700fc8bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:53.384177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb47a8-0b19-4e8c-82d7-270700fc8bf3 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:53.399865 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 874/1758] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:55.212762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce384f-4278-476a-876d-3d7e788d3548 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:55.250034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb47a8-0b19-4e8c-82d7-270700fc8bf3 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:55.260633 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb47a8-0b19-4e8c-82d7-270700fc8bf3 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:55.264765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e103975-1b84-4077-89cc-c2da0815d246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:55.265514 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e103975-1b84-4077-89cc-c2da0815d246 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:55.265852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e103975-1b84-4077-89cc-c2da0815d246 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:55.266191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e103975-1b84-4077-89cc-c2da0815d246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:55.301630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce384f-4278-476a-876d-3d7e788d3548 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:55.319779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:55.319779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:55.319779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:55.319779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] PATH_INFO: `/v3/users/5c6074ee220f4cc9ad7a9fc0b0a33537` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:55.321111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6074ee220f4cc9ad7a9fc0b0a33537)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:55.323182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:55.335475 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e103975-1b84-4077-89cc-c2da0815d246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:55.337186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e103975-1b84-4077-89cc-c2da0815d246 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:55.348012 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 875/1759] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:55.375988 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:55.380537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6074ee220f4cc9ad7a9fc0b0a33537'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:55.381591 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6074ee220f4cc9ad7a9fc0b0a33537'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:55.390610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6074ee220f4cc9ad7a9fc0b0a33537'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:55.391830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6074ee220f4cc9ad7a9fc0b0a33537'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:55.408921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6074ee220f4cc9ad7a9fc0b0a33537'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:55.425289 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 885/1760] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:55 2022] DELETE /identity/v3/users/5c6074ee220f4cc9ad7a9fc0b0a33537 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:55.437152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61070a4-0ae9-4aa7-9ca8-5a1028245a3f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:55.437152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61070a4-0ae9-4aa7-9ca8-5a1028245a3f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:55.437152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61070a4-0ae9-4aa7-9ca8-5a1028245a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:55.455979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b61070a4-0ae9-4aa7-9ca8-5a1028245a3f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:55.457262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b61070a4-0ae9-4aa7-9ca8-5a1028245a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:55.522535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 876/1761] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:55.532846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:55.534446 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:55.595730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769cea0-0df2-40b8-91a7-77e3c851b28c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:55.599975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aac133-5aee-44c6-b606-9014a602da23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:55.600418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aac133-5aee-44c6-b606-9014a602da23 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:55.600814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aac133-5aee-44c6-b606-9014a602da23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:55.601037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aac133-5aee-44c6-b606-9014a602da23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:55.611268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aac133-5aee-44c6-b606-9014a602da23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:55.613266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aac133-5aee-44c6-b606-9014a602da23 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:55.623202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 886/1762] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:55.914824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61070a4-0ae9-4aa7-9ca8-5a1028245a3f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:55.914824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b61070a4-0ae9-4aa7-9ca8-5a1028245a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:55.931201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61070a4-0ae9-4aa7-9ca8-5a1028245a3f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:55.937399 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:55.939505 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:55.940380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:55.940654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] PATH_INFO: `/v3/projects/6eab87dc5836496ebda81be8bf276329` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:55.942438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eab87dc5836496ebda81be8bf276329)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:55.944520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:56.035288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aac133-5aee-44c6-b606-9014a602da23 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:56.036804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-84aac133-5aee-44c6-b606-9014a602da23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:56.057456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eab87dc5836496ebda81be8bf276329', 'request_id': 'req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.077252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eab87dc5836496ebda81be8bf276329', 'request_id': 'req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.086763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eab87dc5836496ebda81be8bf276329', 'request_id': 'req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.099857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] The token cache is being invalidate because project 6eab87dc5836496ebda81be8bf276329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:56.100283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.101075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.105661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 877/1763] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:55 2022] DELETE /identity/v3/projects/6eab87dc5836496ebda81be8bf276329 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:56.106619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:56.108131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:56.121319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aac133-5aee-44c6-b606-9014a602da23 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:56.127935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:56.209430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dbb7e-10ad-4e68-9e59-a0bc3c6b970f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:56.210367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dbb7e-10ad-4e68-9e59-a0bc3c6b970f service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:56.212459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef9f83-d457-4556-ba1d-31f3afc0f77b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:56.212962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dbb7e-10ad-4e68-9e59-a0bc3c6b970f service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:56.213873 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dbb7e-10ad-4e68-9e59-a0bc3c6b970f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:56.215914 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ec8dbb7e-10ad-4e68-9e59-a0bc3c6b970f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:56.216035 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:56.216949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:56.217276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:56.217674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] PATH_INFO: `/v3/users/cb42d75784ca4ae3817ad8f0a5cffe60` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:56.218944 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb42d75784ca4ae3817ad8f0a5cffe60)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:56.221782 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:56.269124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:56.284482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb42d75784ca4ae3817ad8f0a5cffe60'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.295671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb42d75784ca4ae3817ad8f0a5cffe60'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.296545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb42d75784ca4ae3817ad8f0a5cffe60'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.313122 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dbb7e-10ad-4e68-9e59-a0bc3c6b970f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:56.315419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8dbb7e-10ad-4e68-9e59-a0bc3c6b970f service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:56.315599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb42d75784ca4ae3817ad8f0a5cffe60'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.326853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 887/1764] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:56.334306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cfb5a71c-7f0f-43d7-b0b8-6e7fdd4fdb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb42d75784ca4ae3817ad8f0a5cffe60'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.346186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 878/1765] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:56 2022] DELETE /identity/v3/users/cb42d75784ca4ae3817ad8f0a5cffe60 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:56.471544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dbb7e-10ad-4e68-9e59-a0bc3c6b970f service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:56.475749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ec8dbb7e-10ad-4e68-9e59-a0bc3c6b970f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:56.491845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8dbb7e-10ad-4e68-9e59-a0bc3c6b970f service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:56.556951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:56.557649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:56.557940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:56.558249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] PATH_INFO: `/v3/users/3a806c6030c54d429212cf7b712febe5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:56.559498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a806c6030c54d429212cf7b712febe5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:56.561588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:56.631198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a806c6030c54d429212cf7b712febe5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.632189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a806c6030c54d429212cf7b712febe5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.645771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a806c6030c54d429212cf7b712febe5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.646766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a806c6030c54d429212cf7b712febe5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.664905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a806c6030c54d429212cf7b712febe5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.680917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 888/1766] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:56 2022] DELETE /identity/v3/users/3a806c6030c54d429212cf7b712febe5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:56.685649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a690b01-f36d-4ed6-9471-2eaec081ae6e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:56.685938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a690b01-f36d-4ed6-9471-2eaec081ae6e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:56.686212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a690b01-f36d-4ed6-9471-2eaec081ae6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:56.709749 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2a690b01-f36d-4ed6-9471-2eaec081ae6e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:56.710984 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2a690b01-f36d-4ed6-9471-2eaec081ae6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:56.779908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 879/1767] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:56.792778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:56.794257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:56.858086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a690b01-f36d-4ed6-9471-2eaec081ae6e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:56.860752 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2a690b01-f36d-4ed6-9471-2eaec081ae6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:56.877931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a690b01-f36d-4ed6-9471-2eaec081ae6e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:56.886566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:56.887648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:56.889034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:56.889307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:56.889613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] PATH_INFO: `/v3/projects/bb40f67a7c89411e8f0e6065a3914ff9` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:56.890764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb40f67a7c89411e8f0e6065a3914ff9)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:56.892289 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ab51b-ffbd-4377-9cba-854655e1e500 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:56.893719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:56.903075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb131d06-53c8-4358-b3e1-49ba2096c103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:56.904925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131d06-53c8-4358-b3e1-49ba2096c103 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:56.906336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131d06-53c8-4358-b3e1-49ba2096c103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:56.906708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131d06-53c8-4358-b3e1-49ba2096c103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:56.921677 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb131d06-53c8-4358-b3e1-49ba2096c103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:56.923100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb131d06-53c8-4358-b3e1-49ba2096c103 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:56.931400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:56.941187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 889/1768] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:56.960246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb40f67a7c89411e8f0e6065a3914ff9', 'request_id': 'req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.969726 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb40f67a7c89411e8f0e6065a3914ff9', 'request_id': 'req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.977182 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb40f67a7c89411e8f0e6065a3914ff9', 'request_id': 'req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.990068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] The token cache is being invalidate because project bb40f67a7c89411e8f0e6065a3914ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:56.990355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.991028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ca4475a-9f87-4e92-b3e6-1b6904694f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:56.992578 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 880/1769] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:56 2022] DELETE /identity/v3/projects/bb40f67a7c89411e8f0e6065a3914ff9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:56.997613 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338a44-4466-4a6a-a535-7a6c00de209a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:56.998069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338a44-4466-4a6a-a535-7a6c00de209a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:56.998339 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338a44-4466-4a6a-a535-7a6c00de209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.020135 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-62338a44-4466-4a6a-a535-7a6c00de209a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:57.021364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-62338a44-4466-4a6a-a535-7a6c00de209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:57.087081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 890/1770] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:57.095152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd44f-118d-49a8-a94a-62f636df4020 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.095409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd44f-118d-49a8-a94a-62f636df4020 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.095677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd44f-118d-49a8-a94a-62f636df4020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.116284 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-266fd44f-118d-49a8-a94a-62f636df4020 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:57.117717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-266fd44f-118d-49a8-a94a-62f636df4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:57.132149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 881/1771] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:57.134113 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338a44-4466-4a6a-a535-7a6c00de209a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.144577 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338a44-4466-4a6a-a535-7a6c00de209a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:57.149381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef588506-7ffc-413d-8c8b-44cf58765c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:57.150013 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef588506-7ffc-413d-8c8b-44cf58765c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.150293 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef588506-7ffc-413d-8c8b-44cf58765c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.150565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef588506-7ffc-413d-8c8b-44cf58765c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.151237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef588506-7ffc-413d-8c8b-44cf58765c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:57.151543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef588506-7ffc-413d-8c8b-44cf58765c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:57.153166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef588506-7ffc-413d-8c8b-44cf58765c55 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:57.165188 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 891/1772] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:27:57.169596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd44f-118d-49a8-a94a-62f636df4020 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.179851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd44f-118d-49a8-a94a-62f636df4020 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:57.186246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c6348-4994-4a86-b1d4-635e414cfc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:57.186861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c6348-4994-4a86-b1d4-635e414cfc43 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.187134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c6348-4994-4a86-b1d4-635e414cfc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.187402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c6348-4994-4a86-b1d4-635e414cfc43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.188181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c6348-4994-4a86-b1d4-635e414cfc43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:57.190859 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c6348-4994-4a86-b1d4-635e414cfc43 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:57.220008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 882/1773] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:57 2022] POST /identity/v3/projects => generated 409 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:57.224450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef588506-7ffc-413d-8c8b-44cf58765c55 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.235107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef588506-7ffc-413d-8c8b-44cf58765c55 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:57.303757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c6348-4994-4a86-b1d4-635e414cfc43 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.305855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e20c6348-4994-4a86-b1d4-635e414cfc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:57.355296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76143c92-340c-4239-afaa-3ce3e1623ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:57.358637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76143c92-340c-4239-afaa-3ce3e1623ded admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.359254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76143c92-340c-4239-afaa-3ce3e1623ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.359629 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76143c92-340c-4239-afaa-3ce3e1623ded admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.361202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76143c92-340c-4239-afaa-3ce3e1623ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:57.363975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76143c92-340c-4239-afaa-3ce3e1623ded admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:57.396447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c6348-4994-4a86-b1d4-635e414cfc43 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:57.409336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:57.410006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.410282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.410549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] PATH_INFO: `/v3/projects/921e985dc16343659a83dd3d92f1acf0` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.411696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=921e985dc16343659a83dd3d92f1acf0)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:57.413640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:57.422775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 892/1774] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:57 2022] POST /identity/v3/users => generated 305 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:57.434639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76143c92-340c-4239-afaa-3ce3e1623ded admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.477752 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921e985dc16343659a83dd3d92f1acf0', 'request_id': 'req-2b7723a8-cb65-41c3-b39a-daa94de31f31'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:57.493539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76143c92-340c-4239-afaa-3ce3e1623ded admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:57.495062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921e985dc16343659a83dd3d92f1acf0', 'request_id': 'req-2b7723a8-cb65-41c3-b39a-daa94de31f31'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:57.505277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921e985dc16343659a83dd3d92f1acf0', 'request_id': 'req-2b7723a8-cb65-41c3-b39a-daa94de31f31'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:57.525949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] The token cache is being invalidate because project 921e985dc16343659a83dd3d92f1acf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:57.526241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:57.527445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2b7723a8-cb65-41c3-b39a-daa94de31f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:57.541811 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 883/1775] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:57 2022] DELETE /identity/v3/projects/921e985dc16343659a83dd3d92f1acf0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:57.543102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e18c4-8763-4638-b8cd-4415279372f0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.543519 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e18c4-8763-4638-b8cd-4415279372f0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.543798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e18c4-8763-4638-b8cd-4415279372f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.579872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2f9e18c4-8763-4638-b8cd-4415279372f0 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:57.583550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2f9e18c4-8763-4638-b8cd-4415279372f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:57.591895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8ed5a-a0fa-4b1c-89a4-c3b614329b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:57.592532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8ed5a-a0fa-4b1c-89a4-c3b614329b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.592817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8ed5a-a0fa-4b1c-89a4-c3b614329b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.593119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8ed5a-a0fa-4b1c-89a4-c3b614329b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.593781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8ed5a-a0fa-4b1c-89a4-c3b614329b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:57.594894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 884/1776] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:57.595384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8ed5a-a0fa-4b1c-89a4-c3b614329b6b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:57.604248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e27328-46c6-49b5-9e33-a250872f8662 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.604541 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e27328-46c6-49b5-9e33-a250872f8662 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.604814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e27328-46c6-49b5-9e33-a250872f8662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.615706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 893/1777] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:57.619639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8ed5a-a0fa-4b1c-89a4-c3b614329b6b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.621527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bbb8ed5a-a0fa-4b1c-89a4-c3b614329b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:57.632778 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-48e27328-46c6-49b5-9e33-a250872f8662 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:57.632967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:57.634181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-48e27328-46c6-49b5-9e33-a250872f8662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:57.637852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8ed5a-a0fa-4b1c-89a4-c3b614329b6b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:57.650488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bc6b0-15fe-4569-8c90-5fadda1b19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:57.651120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bc6b0-15fe-4569-8c90-5fadda1b19a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.651578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bc6b0-15fe-4569-8c90-5fadda1b19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.651859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bc6b0-15fe-4569-8c90-5fadda1b19a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.652506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bc6b0-15fe-4569-8c90-5fadda1b19a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:57.653348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 885/1778] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:57.655426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bc6b0-15fe-4569-8c90-5fadda1b19a5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:57.656092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e27328-46c6-49b5-9e33-a250872f8662 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.669772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:57.674623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 894/1779] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:27:57.675984 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bc6b0-15fe-4569-8c90-5fadda1b19a5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.691059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bc6b0-15fe-4569-8c90-5fadda1b19a5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:57.691481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e27328-46c6-49b5-9e33-a250872f8662 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:57.696972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae878931-b5f6-494f-8774-d0d83de0018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:57.699136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae878931-b5f6-494f-8774-d0d83de0018c admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.699477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae878931-b5f6-494f-8774-d0d83de0018c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.700844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae878931-b5f6-494f-8774-d0d83de0018c admin admin] PATH_INFO: `/v3/projects/e6272b4d8b8a4599aedbf3cc58f104e5/users/2c14e674e8474aed8ed003fddf3b4379/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.705059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864cc4b-182b-4cd0-b494-30065e5bd347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:57.708132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864cc4b-182b-4cd0-b494-30065e5bd347 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.708419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864cc4b-182b-4cd0-b494-30065e5bd347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.708690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864cc4b-182b-4cd0-b494-30065e5bd347 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.709461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864cc4b-182b-4cd0-b494-30065e5bd347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:27:57.713285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864cc4b-182b-4cd0-b494-30065e5bd347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:57.716536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864cc4b-182b-4cd0-b494-30065e5bd347 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:57.728261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae878931-b5f6-494f-8774-d0d83de0018c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6272b4d8b8a4599aedbf3cc58f104e5, user_id=2c14e674e8474aed8ed003fddf3b4379, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:57.730961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae878931-b5f6-494f-8774-d0d83de0018c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:57.744785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 886/1780] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:27:57.749320 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 895/1781] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:57 2022] PUT /identity/v3/projects/e6272b4d8b8a4599aedbf3cc58f104e5/users/2c14e674e8474aed8ed003fddf3b4379/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:57.753366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864cc4b-182b-4cd0-b494-30065e5bd347 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.760824 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d963d-fe6a-4eb4-9e88-c651ea8f126e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.761171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d963d-fe6a-4eb4-9e88-c651ea8f126e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.761506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d963d-fe6a-4eb4-9e88-c651ea8f126e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.771135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864cc4b-182b-4cd0-b494-30065e5bd347 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:57.807711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-051d963d-fe6a-4eb4-9e88-c651ea8f126e None None] MFA Rules not processed for user `2c14e674e8474aed8ed003fddf3b4379`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:57.808998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-051d963d-fe6a-4eb4-9e88-c651ea8f126e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:57.847829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ce96-aae2-4f8a-bff5-d8af7d6c31b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:57.848927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ce96-aae2-4f8a-bff5-d8af7d6c31b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:57.851431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ce96-aae2-4f8a-bff5-d8af7d6c31b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:57.851858 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ce96-aae2-4f8a-bff5-d8af7d6c31b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:57.852639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5ce96-aae2-4f8a-bff5-d8af7d6c31b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:57.854826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5ce96-aae2-4f8a-bff5-d8af7d6c31b8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:57.908170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 887/1782] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:57 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:57.914079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ce96-aae2-4f8a-bff5-d8af7d6c31b8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.919355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0be5ce96-aae2-4f8a-bff5-d8af7d6c31b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:57.937741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 896/1783] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:57 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:27:57.938656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d963d-fe6a-4eb4-9e88-c651ea8f126e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:57.951567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d963d-fe6a-4eb4-9e88-c651ea8f126e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.027159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07716e53-d71e-4834-9215-2900aa7b6d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.027758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07716e53-d71e-4834-9215-2900aa7b6d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.028264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07716e53-d71e-4834-9215-2900aa7b6d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.028521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07716e53-d71e-4834-9215-2900aa7b6d39 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.029271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07716e53-d71e-4834-9215-2900aa7b6d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.031686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07716e53-d71e-4834-9215-2900aa7b6d39 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.033652 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ce96-aae2-4f8a-bff5-d8af7d6c31b8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.042534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.043378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.043777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.044083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] PATH_INFO: `/v3/users/65b1823de27443e0abdbb2b404127647` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.045365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b1823de27443e0abdbb2b404127647)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.047527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.060369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 897/1784] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:57 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:58.061658 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07716e53-d71e-4834-9215-2900aa7b6d39 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.073091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07716e53-d71e-4834-9215-2900aa7b6d39 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.080786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46328164-c9e5-46bf-b7f7-190f81d57ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.082651 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46328164-c9e5-46bf-b7f7-190f81d57ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.083093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46328164-c9e5-46bf-b7f7-190f81d57ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.083477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46328164-c9e5-46bf-b7f7-190f81d57ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.084181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46328164-c9e5-46bf-b7f7-190f81d57ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.086748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46328164-c9e5-46bf-b7f7-190f81d57ea6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.121867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b1823de27443e0abdbb2b404127647'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:58.137517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 898/1785] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:27:58 2022] POST /identity/v3/projects => generated 407 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:58.137517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46328164-c9e5-46bf-b7f7-190f81d57ea6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.146590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b1823de27443e0abdbb2b404127647'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:58.147217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b1823de27443e0abdbb2b404127647'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:58.166478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b1823de27443e0abdbb2b404127647'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:58.173095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:58.177043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b1823de27443e0abdbb2b404127647'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:58.195931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 888/1786] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:57 2022] DELETE /identity/v3/users/65b1823de27443e0abdbb2b404127647 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:58.196896 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.198651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:58.204626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:58.259340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46328164-c9e5-46bf-b7f7-190f81d57ea6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.313429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493fbca-b180-4030-8ade-bedb64522a17 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.319264 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8405a-26db-4678-afdf-286949d82cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.319974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8405a-26db-4678-afdf-286949d82cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.320440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8405a-26db-4678-afdf-286949d82cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.320777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8405a-26db-4678-afdf-286949d82cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.321582 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8405a-26db-4678-afdf-286949d82cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.323558 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8405a-26db-4678-afdf-286949d82cc5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.331309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd667cf-d2f0-4b51-bec6-2a39da8c41d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.332115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd667cf-d2f0-4b51-bec6-2a39da8c41d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.332529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd667cf-d2f0-4b51-bec6-2a39da8c41d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.333282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd667cf-d2f0-4b51-bec6-2a39da8c41d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.334325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd667cf-d2f0-4b51-bec6-2a39da8c41d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.336430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd667cf-d2f0-4b51-bec6-2a39da8c41d2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.346483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 889/1787] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:27:58 2022] POST /identity/v3/users => generated 310 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:27:58.351306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d7101-df00-4c5f-b0a4-e53f3cc48fe1 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.351548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d7101-df00-4c5f-b0a4-e53f3cc48fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.351822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d7101-df00-4c5f-b0a4-e53f3cc48fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.352578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 899/1788] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:58.353455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd667cf-d2f0-4b51-bec6-2a39da8c41d2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.367073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd667cf-d2f0-4b51-bec6-2a39da8c41d2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.372146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048da47-a5ba-4a05-b5ad-2823f0726b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.372765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048da47-a5ba-4a05-b5ad-2823f0726b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.373059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048da47-a5ba-4a05-b5ad-2823f0726b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.373320 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048da47-a5ba-4a05-b5ad-2823f0726b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.373960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048da47-a5ba-4a05-b5ad-2823f0726b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.374374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b33d7101-df00-4c5f-b0a4-e53f3cc48fe1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:58.375560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048da47-a5ba-4a05-b5ad-2823f0726b58 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.375740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b33d7101-df00-4c5f-b0a4-e53f3cc48fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:58.383857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 890/1789] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:58.384638 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d7101-df00-4c5f-b0a4-e53f3cc48fe1 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.386477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b33d7101-df00-4c5f-b0a4-e53f3cc48fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:58.390281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 900/1790] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:58.391229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048da47-a5ba-4a05-b5ad-2823f0726b58 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.402722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d7101-df00-4c5f-b0a4-e53f3cc48fe1 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.403046 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048da47-a5ba-4a05-b5ad-2823f0726b58 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.407518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6f8a4-e688-4a81-b1ef-4648ff6fff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.408124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6f8a4-e688-4a81-b1ef-4648ff6fff43 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.408925 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6f8a4-e688-4a81-b1ef-4648ff6fff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.409246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6f8a4-e688-4a81-b1ef-4648ff6fff43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.409352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6c15-44cf-410a-9416-2ed0ec9cac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.409889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6f8a4-e688-4a81-b1ef-4648ff6fff43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.410260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6c15-44cf-410a-9416-2ed0ec9cac62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.410616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6c15-44cf-410a-9416-2ed0ec9cac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.410952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6c15-44cf-410a-9416-2ed0ec9cac62 admin admin] PATH_INFO: `/v3/projects/f192c9b5c1914bf8bac054309980e1b5/users/4f78884b72154364a6da17962f23fd80/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.411802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6f8a4-e688-4a81-b1ef-4648ff6fff43 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.422937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 891/1791] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:58.423769 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6f8a4-e688-4a81-b1ef-4648ff6fff43 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.425580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-92a6f8a4-e688-4a81-b1ef-4648ff6fff43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:58.427369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf6c15-44cf-410a-9416-2ed0ec9cac62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f192c9b5c1914bf8bac054309980e1b5, user_id=4f78884b72154364a6da17962f23fd80, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.429977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf6c15-44cf-410a-9416-2ed0ec9cac62 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.446277 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 901/1792] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:58 2022] PUT /identity/v3/projects/f192c9b5c1914bf8bac054309980e1b5/users/4f78884b72154364a6da17962f23fd80/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:58.447738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6c15-44cf-410a-9416-2ed0ec9cac62 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.506055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6f8a4-e688-4a81-b1ef-4648ff6fff43 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.540382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6c15-44cf-410a-9416-2ed0ec9cac62 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.545560 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829ee6c-cba4-45be-9992-955e78554075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.546302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829ee6c-cba4-45be-9992-955e78554075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.546645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829ee6c-cba4-45be-9992-955e78554075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.547026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829ee6c-cba4-45be-9992-955e78554075 admin admin] PATH_INFO: `/v3/projects/ee292fd9e6d04df3b56c0d677100582d/users/c71e8cf23e89455b905a8bc34e794b31/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.567590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829ee6c-cba4-45be-9992-955e78554075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee292fd9e6d04df3b56c0d677100582d, user_id=c71e8cf23e89455b905a8bc34e794b31, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.570315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829ee6c-cba4-45be-9992-955e78554075 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.570767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818593b8-1858-443d-944a-b540424ea98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.571437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818593b8-1858-443d-944a-b540424ea98c service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.571714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818593b8-1858-443d-944a-b540424ea98c service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.572157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818593b8-1858-443d-944a-b540424ea98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.583729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818593b8-1858-443d-944a-b540424ea98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.585120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818593b8-1858-443d-944a-b540424ea98c service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.587982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 902/1793] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:58 2022] PUT /identity/v3/projects/ee292fd9e6d04df3b56c0d677100582d/users/c71e8cf23e89455b905a8bc34e794b31/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:58.588988 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829ee6c-cba4-45be-9992-955e78554075 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.608604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 892/1794] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:58.609960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896175e6-25fa-41cb-8b95-864c029c15a6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.610238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896175e6-25fa-41cb-8b95-864c029c15a6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.610508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896175e6-25fa-41cb-8b95-864c029c15a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.622646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:58.649371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-896175e6-25fa-41cb-8b95-864c029c15a6 None None] MFA Rules not processed for user `c71e8cf23e89455b905a8bc34e794b31`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:58.651139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-896175e6-25fa-41cb-8b95-864c029c15a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:58.670878 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:58.686697 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829ee6c-cba4-45be-9992-955e78554075 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.692888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68442c-48b5-4dcd-9dda-b11dd601ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.693597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68442c-48b5-4dcd-9dda-b11dd601ae37 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.693883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68442c-48b5-4dcd-9dda-b11dd601ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.694917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68442c-48b5-4dcd-9dda-b11dd601ae37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.695587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68442c-48b5-4dcd-9dda-b11dd601ae37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.697590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68442c-48b5-4dcd-9dda-b11dd601ae37 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.715115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 903/1795] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:27:58.716154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68442c-48b5-4dcd-9dda-b11dd601ae37 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.729644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68442c-48b5-4dcd-9dda-b11dd601ae37 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.735311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b406bd-662c-4045-a26a-64141353118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.738371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b406bd-662c-4045-a26a-64141353118e admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.738674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b406bd-662c-4045-a26a-64141353118e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.738955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b406bd-662c-4045-a26a-64141353118e admin admin] PATH_INFO: `/v3/projects/f192c9b5c1914bf8bac054309980e1b5/users/4f78884b72154364a6da17962f23fd80/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.741490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b406bd-662c-4045-a26a-64141353118e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f192c9b5c1914bf8bac054309980e1b5, user_id=4f78884b72154364a6da17962f23fd80, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:58.745386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b406bd-662c-4045-a26a-64141353118e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:58.757723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 893/1796] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:58.758102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 904/1797] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:27:58 2022] PUT /identity/v3/projects/f192c9b5c1914bf8bac054309980e1b5/users/4f78884b72154364a6da17962f23fd80/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:58.764192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896175e6-25fa-41cb-8b95-864c029c15a6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.766458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-896175e6-25fa-41cb-8b95-864c029c15a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:58.769436 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab27ffd-d5c7-4d72-925e-242d9e83b937 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.769745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab27ffd-d5c7-4d72-925e-242d9e83b937 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.770035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab27ffd-d5c7-4d72-925e-242d9e83b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.810448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4ab27ffd-d5c7-4d72-925e-242d9e83b937 None None] MFA Rules not processed for user `4f78884b72154364a6da17962f23fd80`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:27:58.811671 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4ab27ffd-d5c7-4d72-925e-242d9e83b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:58.854823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896175e6-25fa-41cb-8b95-864c029c15a6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.907918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 905/1798] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:27:58 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:27:58.921833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab27ffd-d5c7-4d72-925e-242d9e83b937 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:58.924705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4ab27ffd-d5c7-4d72-925e-242d9e83b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:58.932817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86a5e7-1e51-4cd4-b991-90434e63a341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.933392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a5e7-1e51-4cd4-b991-90434e63a341 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.933664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a5e7-1e51-4cd4-b991-90434e63a341 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.933922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a5e7-1e51-4cd4-b991-90434e63a341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:58.993578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab27ffd-d5c7-4d72-925e-242d9e83b937 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:58.998410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e37d7-d7ad-45ef-bdd7-68c587d0de1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:58.999019 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e37d7-d7ad-45ef-bdd7-68c587d0de1f service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:58.999296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e37d7-d7ad-45ef-bdd7-68c587d0de1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:58.999563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e37d7-d7ad-45ef-bdd7-68c587d0de1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:59.012713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86a5e7-1e51-4cd4-b991-90434e63a341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:59.014432 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e37d7-d7ad-45ef-bdd7-68c587d0de1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:59.014623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86a5e7-1e51-4cd4-b991-90434e63a341 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:59.015994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e37d7-d7ad-45ef-bdd7-68c587d0de1f service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:59.025373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 894/1799] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:27:59.026226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86a5e7-1e51-4cd4-b991-90434e63a341 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:59.027959 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ce86a5e7-1e51-4cd4-b991-90434e63a341 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:59.030730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 906/1800] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:58 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:59.083335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:59.146312 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86a5e7-1e51-4cd4-b991-90434e63a341 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:59.162019 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:59.162679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:59.162955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:59.163496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] PATH_INFO: `/v3/projects/f7410972d09142439c888d8affb4df3c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:59.166156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7410972d09142439c888d8affb4df3c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:59.169351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:59.254996 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7410972d09142439c888d8affb4df3c', 'request_id': 'req-f2f2939f-6233-4c8f-b345-d9d3728306a2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:59.263439 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7410972d09142439c888d8affb4df3c', 'request_id': 'req-f2f2939f-6233-4c8f-b345-d9d3728306a2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:59.271623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7410972d09142439c888d8affb4df3c', 'request_id': 'req-f2f2939f-6233-4c8f-b345-d9d3728306a2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:59.284732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] The token cache is being invalidate because project f7410972d09142439c888d8affb4df3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:27:59.285124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:59.285843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:59.287610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 895/1801] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:59 2022] DELETE /identity/v3/projects/f7410972d09142439c888d8affb4df3c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:27:59.291680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e37d7-d7ad-45ef-bdd7-68c587d0de1f service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:59.304549 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e37d7-d7ad-45ef-bdd7-68c587d0de1f service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:59.351541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:59.363390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:59.364818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:59.406462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:59.407105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:59.408827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:59.409104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] PATH_INFO: `/v3/users/9ce632d9d4494437bf5aaec74548126e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:59.412921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce632d9d4494437bf5aaec74548126e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:59.416461 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:59.481149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2939f-6233-4c8f-b345-d9d3728306a2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:27:59.486175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a94982-bd48-4874-98a3-daee604431bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:27:59.486848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a94982-bd48-4874-98a3-daee604431bc service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:27:59.487133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a94982-bd48-4874-98a3-daee604431bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:27:59.487493 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a94982-bd48-4874-98a3-daee604431bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:27:59.489636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c8a94982-bd48-4874-98a3-daee604431bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:27:59.491744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce632d9d4494437bf5aaec74548126e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:59.492926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce632d9d4494437bf5aaec74548126e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:59.500734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce632d9d4494437bf5aaec74548126e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:59.501363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce632d9d4494437bf5aaec74548126e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:59.514170 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce632d9d4494437bf5aaec74548126e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:27:59.529923 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 907/1802] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:27:59 2022] DELETE /identity/v3/users/9ce632d9d4494437bf5aaec74548126e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:27:59.571832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a94982-bd48-4874-98a3-daee604431bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:27:59.573966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a94982-bd48-4874-98a3-daee604431bc service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:27:59.583765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 896/1803] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:27:59 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:27:59.931982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:27:59.944734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:00.059779 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cd206-9f38-459b-98f7-b335a69892de admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:00.067482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:00.068168 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:00.068455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:00.068785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] PATH_INFO: `/v3/projects/cec931318abd46d482ab65247c841da7` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:00.069973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec931318abd46d482ab65247c841da7)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:00.072001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:00.127014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec931318abd46d482ab65247c841da7', 'request_id': 'req-e1123d31-ead9-44b8-b64d-b350968eed67'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.127813 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:00.134729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec931318abd46d482ab65247c841da7', 'request_id': 'req-e1123d31-ead9-44b8-b64d-b350968eed67'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.141959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec931318abd46d482ab65247c841da7', 'request_id': 'req-e1123d31-ead9-44b8-b64d-b350968eed67'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.155528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] The token cache is being invalidate because project cec931318abd46d482ab65247c841da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:00.155834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.156470 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.158001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 908/1804] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:27:59 2022] DELETE /identity/v3/projects/cec931318abd46d482ab65247c841da7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:00.163096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a94982-bd48-4874-98a3-daee604431bc service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:00.164738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c8a94982-bd48-4874-98a3-daee604431bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:00.179000 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a94982-bd48-4874-98a3-daee604431bc service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:00.187402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:00.248188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:00.248826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:00.249144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:00.249398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] PATH_INFO: `/v3/users/7e23317d03b34f908d92cdde065a57a6` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:00.250525 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e23317d03b34f908d92cdde065a57a6)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:00.252973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:00.305779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e23317d03b34f908d92cdde065a57a6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.312851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e23317d03b34f908d92cdde065a57a6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.313554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e23317d03b34f908d92cdde065a57a6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.326062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e23317d03b34f908d92cdde065a57a6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.333510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-717ac49e-6273-4748-84bc-89c8665c2caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e23317d03b34f908d92cdde065a57a6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.339679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 897/1805] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:00 2022] DELETE /identity/v3/users/7e23317d03b34f908d92cdde065a57a6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:00.626478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:00.630864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:00.656975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1123d31-ead9-44b8-b64d-b350968eed67 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:00.732018 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:00.737202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:00.737202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:00.737202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] PATH_INFO: `/v3/projects/6cc06dccbc4e488197eb0849f6ed44aa` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:00.737202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc06dccbc4e488197eb0849f6ed44aa)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:00.737870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:00.790214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc06dccbc4e488197eb0849f6ed44aa', 'request_id': 'req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.795776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc06dccbc4e488197eb0849f6ed44aa', 'request_id': 'req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.802729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc06dccbc4e488197eb0849f6ed44aa', 'request_id': 'req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.816360 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] The token cache is being invalidate because project 6cc06dccbc4e488197eb0849f6ed44aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:00.816656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.817387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:00.818972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 909/1806] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:00 2022] DELETE /identity/v3/projects/6cc06dccbc4e488197eb0849f6ed44aa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:00.824981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d116d-9e2c-4a51-85d8-f2183538acfb None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:00.825470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d116d-9e2c-4a51-85d8-f2183538acfb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:00.825930 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d116d-9e2c-4a51-85d8-f2183538acfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:00.847122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0d9d116d-9e2c-4a51-85d8-f2183538acfb None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:00.848715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0d9d116d-9e2c-4a51-85d8-f2183538acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:00.876676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:00.878182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:00.920825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 898/1807] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:00.929501 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fda3-f4b3-4355-b7e1-eb69a4f15a8e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:00.930408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fda3-f4b3-4355-b7e1-eb69a4f15a8e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:00.930687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fda3-f4b3-4355-b7e1-eb69a4f15a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:00.954142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33d76f-5d6a-49e7-93ef-6c2f3e180f52 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:00.954893 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3932fda3-f4b3-4355-b7e1-eb69a4f15a8e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:00.957410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3932fda3-f4b3-4355-b7e1-eb69a4f15a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:00.959428 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:00.960059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:00.960337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:00.960734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] PATH_INFO: `/v3/users/c94c45c0d49d4f0fb188d5460bcab58b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:00.961887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94c45c0d49d4f0fb188d5460bcab58b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:00.963788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:00.969382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 899/1808] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:00.973845 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fda3-f4b3-4355-b7e1-eb69a4f15a8e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:00.984288 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:00.990736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fda3-f4b3-4355-b7e1-eb69a4f15a8e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:01.011408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c444d4-c107-4ed9-99c3-42fa5ad09ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:01.011408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c444d4-c107-4ed9-99c3-42fa5ad09ada admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.011408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c444d4-c107-4ed9-99c3-42fa5ad09ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.011408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c444d4-c107-4ed9-99c3-42fa5ad09ada admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.012122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c444d4-c107-4ed9-99c3-42fa5ad09ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:01.012322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c444d4-c107-4ed9-99c3-42fa5ad09ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:01.013941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c444d4-c107-4ed9-99c3-42fa5ad09ada admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:01.028176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 900/1809] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:28:01.032242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c444d4-c107-4ed9-99c3-42fa5ad09ada admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:01.038573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94c45c0d49d4f0fb188d5460bcab58b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:01.039539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94c45c0d49d4f0fb188d5460bcab58b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:01.044387 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c444d4-c107-4ed9-99c3-42fa5ad09ada admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:01.049572 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94c45c0d49d4f0fb188d5460bcab58b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:01.050182 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080301a-0ea2-4b74-8a3d-0623e859365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:01.050509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94c45c0d49d4f0fb188d5460bcab58b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:01.050789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080301a-0ea2-4b74-8a3d-0623e859365e admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.051065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080301a-0ea2-4b74-8a3d-0623e859365e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.051332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080301a-0ea2-4b74-8a3d-0623e859365e admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.051997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080301a-0ea2-4b74-8a3d-0623e859365e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:01.054039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080301a-0ea2-4b74-8a3d-0623e859365e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:01.066701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-6bca6c34-4f43-4890-abaa-1bdbc6a3cb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94c45c0d49d4f0fb188d5460bcab58b'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:01.067489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:01.088609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 910/1810] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:00 2022] DELETE /identity/v3/users/c94c45c0d49d4f0fb188d5460bcab58b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:01.093764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19f583-102c-4a5d-89cc-a5532c9d1426 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.094358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19f583-102c-4a5d-89cc-a5532c9d1426 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.094703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19f583-102c-4a5d-89cc-a5532c9d1426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.101280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 901/1811] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:01 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:01.104703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080301a-0ea2-4b74-8a3d-0623e859365e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:01.110513 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9080301a-0ea2-4b74-8a3d-0623e859365e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:01.129769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5a19f583-102c-4a5d-89cc-a5532c9d1426 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:01.131127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5a19f583-102c-4a5d-89cc-a5532c9d1426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:01.209705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080301a-0ea2-4b74-8a3d-0623e859365e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:01.220178 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54aaf4-9253-4a1e-89a2-0faf36b85d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:01.221577 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54aaf4-9253-4a1e-89a2-0faf36b85d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.221857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54aaf4-9253-4a1e-89a2-0faf36b85d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.222179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54aaf4-9253-4a1e-89a2-0faf36b85d33 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.223041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54aaf4-9253-4a1e-89a2-0faf36b85d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:01.225049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54aaf4-9253-4a1e-89a2-0faf36b85d33 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:01.229379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 911/1812] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:01.240367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19f583-102c-4a5d-89cc-a5532c9d1426 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:01.242009 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5a19f583-102c-4a5d-89cc-a5532c9d1426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:01.249684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 902/1813] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:01 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:01.253586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54aaf4-9253-4a1e-89a2-0faf36b85d33 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:01.263482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54aaf4-9253-4a1e-89a2-0faf36b85d33 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:01.268738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85ec8f-7029-4440-a966-0e8736b83f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:01.269369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ec8f-7029-4440-a966-0e8736b83f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.269689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ec8f-7029-4440-a966-0e8736b83f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.269977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85ec8f-7029-4440-a966-0e8736b83f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.270613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85ec8f-7029-4440-a966-0e8736b83f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:01.272215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85ec8f-7029-4440-a966-0e8736b83f8f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:01.282512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 903/1814] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:28:01.287296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85ec8f-7029-4440-a966-0e8736b83f8f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:01.297221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85ec8f-7029-4440-a966-0e8736b83f8f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:01.304811 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d030e3-c18e-4482-9653-7e3e728fa4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:01.305638 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d030e3-c18e-4482-9653-7e3e728fa4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.306083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d030e3-c18e-4482-9653-7e3e728fa4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.306618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d030e3-c18e-4482-9653-7e3e728fa4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.307316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19f583-102c-4a5d-89cc-a5532c9d1426 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:01.308025 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d030e3-c18e-4482-9653-7e3e728fa4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:01.309775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d030e3-c18e-4482-9653-7e3e728fa4b3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:01.311240 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b40b6-cad7-4f66-be33-a917631e0a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:01.311808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b40b6-cad7-4f66-be33-a917631e0a89 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.312076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b40b6-cad7-4f66-be33-a917631e0a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.312341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b40b6-cad7-4f66-be33-a917631e0a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.322667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b40b6-cad7-4f66-be33-a917631e0a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:01.324434 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b40b6-cad7-4f66-be33-a917631e0a89 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:01.329054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 904/1815] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:28:01.332902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d030e3-c18e-4482-9653-7e3e728fa4b3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:01.345486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d030e3-c18e-4482-9653-7e3e728fa4b3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:01.349092 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 912/1816] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:28:01.352060 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268058-2fa5-44c6-97ce-c3a1e42c4bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:01.352745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268058-2fa5-44c6-97ce-c3a1e42c4bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.353300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268058-2fa5-44c6-97ce-c3a1e42c4bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.353799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268058-2fa5-44c6-97ce-c3a1e42c4bd7 admin admin] PATH_INFO: `/v3/projects/88b36a022c0349a9abfcdb8d338e6119/users/23f4b815a3204fccbf41d825ccf9f9a8/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.378476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd268058-2fa5-44c6-97ce-c3a1e42c4bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b36a022c0349a9abfcdb8d338e6119, user_id=23f4b815a3204fccbf41d825ccf9f9a8, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:01.381851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd268058-2fa5-44c6-97ce-c3a1e42c4bd7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:01.400641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 905/1817] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:01 2022] PUT /identity/v3/projects/88b36a022c0349a9abfcdb8d338e6119/users/23f4b815a3204fccbf41d825ccf9f9a8/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:01.413895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb42d04-7074-4e2d-9c28-1955dc3adddd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.413895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb42d04-7074-4e2d-9c28-1955dc3adddd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.413895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb42d04-7074-4e2d-9c28-1955dc3adddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.443766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6bb42d04-7074-4e2d-9c28-1955dc3adddd None None] MFA Rules not processed for user `23f4b815a3204fccbf41d825ccf9f9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:01.445053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6bb42d04-7074-4e2d-9c28-1955dc3adddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:01.466044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:01.525602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 913/1818] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:01.536211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268058-2fa5-44c6-97ce-c3a1e42c4bd7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:01.538011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fd268058-2fa5-44c6-97ce-c3a1e42c4bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:01.596187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268058-2fa5-44c6-97ce-c3a1e42c4bd7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:01.600165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cf1a0-0140-407d-b3b1-e9c3019669e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:01.600779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cf1a0-0140-407d-b3b1-e9c3019669e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.601081 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cf1a0-0140-407d-b3b1-e9c3019669e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.601355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cf1a0-0140-407d-b3b1-e9c3019669e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.610012 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cf1a0-0140-407d-b3b1-e9c3019669e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:01.612107 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cf1a0-0140-407d-b3b1-e9c3019669e1 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:01.621544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 906/1819] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:01.786582 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb42d04-7074-4e2d-9c28-1955dc3adddd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:01.788873 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6bb42d04-7074-4e2d-9c28-1955dc3adddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:01.818298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cf1a0-0140-407d-b3b1-e9c3019669e1 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:01.820302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ca5cf1a0-0140-407d-b3b1-e9c3019669e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:01.880571 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:01.898447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb42d04-7074-4e2d-9c28-1955dc3adddd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:01.929510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:01.930777 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.930777 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.931072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] PATH_INFO: `/v3/users/c71e8cf23e89455b905a8bc34e794b31` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.932602 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71e8cf23e89455b905a8bc34e794b31)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:01.934682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:01.961639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cf1a0-0140-407d-b3b1-e9c3019669e1 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:01.978407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:01.979097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:01.979522 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:01.979802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] PATH_INFO: `/v3/projects/e43b2b9a9d504692941fbc95bfa5a57c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:01.982211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43b2b9a9d504692941fbc95bfa5a57c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:01.991459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:02.021471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71e8cf23e89455b905a8bc34e794b31'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.022538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71e8cf23e89455b905a8bc34e794b31'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.033967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71e8cf23e89455b905a8bc34e794b31'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.035572 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71e8cf23e89455b905a8bc34e794b31'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.052055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1c3d1875-dbf1-4fdd-b48a-b3960e624643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71e8cf23e89455b905a8bc34e794b31'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.068745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 914/1820] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:01 2022] DELETE /identity/v3/users/c71e8cf23e89455b905a8bc34e794b31 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:02.071434 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43b2b9a9d504692941fbc95bfa5a57c', 'request_id': 'req-e2226202-1210-4540-be4e-0f2141df2f41'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.073470 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abdf5f-4d85-4dbc-8191-f0d562759bcd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:02.073750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abdf5f-4d85-4dbc-8191-f0d562759bcd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:02.074055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abdf5f-4d85-4dbc-8191-f0d562759bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:02.082574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43b2b9a9d504692941fbc95bfa5a57c', 'request_id': 'req-e2226202-1210-4540-be4e-0f2141df2f41'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.089490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43b2b9a9d504692941fbc95bfa5a57c', 'request_id': 'req-e2226202-1210-4540-be4e-0f2141df2f41'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.096891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-96abdf5f-4d85-4dbc-8191-f0d562759bcd None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:02.098503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-96abdf5f-4d85-4dbc-8191-f0d562759bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:02.103478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] The token cache is being invalidate because project e43b2b9a9d504692941fbc95bfa5a57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:02.103907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.104703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.106341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 907/1821] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:01 2022] DELETE /identity/v3/projects/e43b2b9a9d504692941fbc95bfa5a57c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:02.110644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:02.112343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:02.146583 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:02.181987 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 915/1822] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:02.186647 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2226202-1210-4540-be4e-0f2141df2f41 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:02.192684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:02.193386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:02.193660 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:02.194080 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] PATH_INFO: `/v3/users/a1d49a57be314993b552519698786072` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:02.194896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abdf5f-4d85-4dbc-8191-f0d562759bcd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:02.195384 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d49a57be314993b552519698786072)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:02.197352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:02.197550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-96abdf5f-4d85-4dbc-8191-f0d562759bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:02.264378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d49a57be314993b552519698786072'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.275577 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d49a57be314993b552519698786072'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.276849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d49a57be314993b552519698786072'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.296133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:02.299422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abdf5f-4d85-4dbc-8191-f0d562759bcd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:02.299577 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d49a57be314993b552519698786072'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.303642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95dfd7-cfee-4d0b-81ca-2e828850deb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:02.304656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95dfd7-cfee-4d0b-81ca-2e828850deb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:02.305128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95dfd7-cfee-4d0b-81ca-2e828850deb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:02.305512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95dfd7-cfee-4d0b-81ca-2e828850deb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:02.308798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dc95dfd7-cfee-4d0b-81ca-2e828850deb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:02.317728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d49a57be314993b552519698786072'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.324181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 908/1823] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:02 2022] DELETE /identity/v3/users/a1d49a57be314993b552519698786072 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:02.330775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95dfd7-cfee-4d0b-81ca-2e828850deb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:02.333240 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95dfd7-cfee-4d0b-81ca-2e828850deb0 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:02.346767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 916/1824] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:02.788037 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:02.789531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:02.870129 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfb4a0-89e3-4b8e-bb5b-c79c4586dc94 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:02.875484 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:02.876137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:02.876418 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:02.876693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] PATH_INFO: `/v3/projects/1693b7ad4c894fdfb0e0c9fac03f682e` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:02.878180 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1693b7ad4c894fdfb0e0c9fac03f682e)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:02.880161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:02.937810 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95dfd7-cfee-4d0b-81ca-2e828850deb0 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:02.940404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dc95dfd7-cfee-4d0b-81ca-2e828850deb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:02.940928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1693b7ad4c894fdfb0e0c9fac03f682e', 'request_id': 'req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.951671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1693b7ad4c894fdfb0e0c9fac03f682e', 'request_id': 'req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.961157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1693b7ad4c894fdfb0e0c9fac03f682e', 'request_id': 'req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.970188 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95dfd7-cfee-4d0b-81ca-2e828850deb0 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:02.976125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] The token cache is being invalidate because project 1693b7ad4c894fdfb0e0c9fac03f682e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:02.976713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.977999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:02.981074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 909/1825] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:02 2022] DELETE /identity/v3/projects/1693b7ad4c894fdfb0e0c9fac03f682e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:02.985612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:02.987842 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:03.048328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:03.049605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:03.049903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:03.050172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] PATH_INFO: `/v3/projects/ee292fd9e6d04df3b56c0d677100582d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:03.051534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee292fd9e6d04df3b56c0d677100582d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:03.054447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:03.101276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceb1cc-3641-44ee-a33a-a02037dcc5ae admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:03.109375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:03.110159 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:03.110515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:03.110780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] PATH_INFO: `/v3/users/544ff744cbf749d3b3a03807e6e34877` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:03.113275 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] RBAC: Authorizing `identity:delete_user(user_id=544ff744cbf749d3b3a03807e6e34877)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:03.115366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:03.142980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee292fd9e6d04df3b56c0d677100582d', 'request_id': 'req-73e204ba-737b-42e6-9081-8aee65d14c0a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:03.144700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:03.151375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee292fd9e6d04df3b56c0d677100582d', 'request_id': 'req-73e204ba-737b-42e6-9081-8aee65d14c0a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:03.161840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee292fd9e6d04df3b56c0d677100582d', 'request_id': 'req-73e204ba-737b-42e6-9081-8aee65d14c0a'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:03.187024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] The token cache is being invalidate because project ee292fd9e6d04df3b56c0d677100582d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:03.187584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:03.188593 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-73e204ba-737b-42e6-9081-8aee65d14c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:03.194274 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 917/1826] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:02 2022] DELETE /identity/v3/projects/ee292fd9e6d04df3b56c0d677100582d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:03.196294 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c978-9854-4aee-b8be-20245c32de79 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:03.196886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c978-9854-4aee-b8be-20245c32de79 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:03.197381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c978-9854-4aee-b8be-20245c32de79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:03.208284 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544ff744cbf749d3b3a03807e6e34877'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:03.225902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544ff744cbf749d3b3a03807e6e34877'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:03.227229 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544ff744cbf749d3b3a03807e6e34877'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:03.228267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2fa3c978-9854-4aee-b8be-20245c32de79 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:03.230620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2fa3c978-9854-4aee-b8be-20245c32de79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:03.243998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:03.269300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544ff744cbf749d3b3a03807e6e34877'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:03.288007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7f632437-ab97-4d04-b648-0b7f02efd50c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544ff744cbf749d3b3a03807e6e34877'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:03.301796 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 910/1827] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:02 2022] DELETE /identity/v3/users/544ff744cbf749d3b3a03807e6e34877 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:03.333640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 918/1828] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:03.334848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320165d-4027-4455-92f8-ee79c0119cac None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:03.335130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320165d-4027-4455-92f8-ee79c0119cac None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:03.335400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320165d-4027-4455-92f8-ee79c0119cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:03.386287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b320165d-4027-4455-92f8-ee79c0119cac None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:03.393236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b320165d-4027-4455-92f8-ee79c0119cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:03.494002 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 911/1829] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:03.498494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3c978-9854-4aee-b8be-20245c32de79 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:03.508656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3c978-9854-4aee-b8be-20245c32de79 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:03.532695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3a818-5ecc-4dfe-b0aa-60e5f4bb8fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:03.534746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a818-5ecc-4dfe-b0aa-60e5f4bb8fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:03.535796 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a818-5ecc-4dfe-b0aa-60e5f4bb8fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:03.537342 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a818-5ecc-4dfe-b0aa-60e5f4bb8fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:03.538120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a818-5ecc-4dfe-b0aa-60e5f4bb8fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:03.538371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a818-5ecc-4dfe-b0aa-60e5f4bb8fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:03.543562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a818-5ecc-4dfe-b0aa-60e5f4bb8fbd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:03.556852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 919/1830] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:03.561406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320165d-4027-4455-92f8-ee79c0119cac None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:03.572434 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320165d-4027-4455-92f8-ee79c0119cac None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:03.584198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59f23e-f134-45b8-a2a6-66de4464c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:03.586345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59f23e-f134-45b8-a2a6-66de4464c150 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:03.586697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59f23e-f134-45b8-a2a6-66de4464c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:03.587120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59f23e-f134-45b8-a2a6-66de4464c150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:03.589328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59f23e-f134-45b8-a2a6-66de4464c150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:03.596769 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59f23e-f134-45b8-a2a6-66de4464c150 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:03.646829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 912/1831] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:03 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:03.648430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3a818-5ecc-4dfe-b0aa-60e5f4bb8fbd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:03.670273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3a818-5ecc-4dfe-b0aa-60e5f4bb8fbd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:03.788700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09715a-6cd5-4c4e-9637-a16c47a54ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:03.789317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09715a-6cd5-4c4e-9637-a16c47a54ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:03.789749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09715a-6cd5-4c4e-9637-a16c47a54ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:03.790040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09715a-6cd5-4c4e-9637-a16c47a54ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:03.790877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09715a-6cd5-4c4e-9637-a16c47a54ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:03.795599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09715a-6cd5-4c4e-9637-a16c47a54ac7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:03.797045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59f23e-f134-45b8-a2a6-66de4464c150 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:03.802555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9f59f23e-f134-45b8-a2a6-66de4464c150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:03.855079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59f23e-f134-45b8-a2a6-66de4464c150 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:03.856967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 920/1832] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:03 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:03.858521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09715a-6cd5-4c4e-9637-a16c47a54ac7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:03.884634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:03.887530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:03.887864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:03.889230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] PATH_INFO: `/v3/projects/14ea91ce2fe14c2083a08eb3f95fad0b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:03.896431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ea91ce2fe14c2083a08eb3f95fad0b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:03.898569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:03.919435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09715a-6cd5-4c4e-9637-a16c47a54ac7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:03.929386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db046ed5-72a4-475c-bb49-069b23a7dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:03.930327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db046ed5-72a4-475c-bb49-069b23a7dc00 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:03.930701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db046ed5-72a4-475c-bb49-069b23a7dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:03.930927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db046ed5-72a4-475c-bb49-069b23a7dc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:03.931587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db046ed5-72a4-475c-bb49-069b23a7dc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:03.933900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db046ed5-72a4-475c-bb49-069b23a7dc00 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:03.957697 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 921/1833] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:03.961790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db046ed5-72a4-475c-bb49-069b23a7dc00 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:03.979097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db046ed5-72a4-475c-bb49-069b23a7dc00 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:03.999350 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ea91ce2fe14c2083a08eb3f95fad0b', 'request_id': 'req-35e5edfe-2a21-4b59-af21-5b5abf98eeda'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:04.019754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ea91ce2fe14c2083a08eb3f95fad0b', 'request_id': 'req-35e5edfe-2a21-4b59-af21-5b5abf98eeda'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:04.027938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ea91ce2fe14c2083a08eb3f95fad0b', 'request_id': 'req-35e5edfe-2a21-4b59-af21-5b5abf98eeda'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:04.031665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:04.047272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] The token cache is being invalidate because project 14ea91ce2fe14c2083a08eb3f95fad0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:04.047540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:04.053066 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-35e5edfe-2a21-4b59-af21-5b5abf98eeda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:04.056299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 913/1834] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:03 2022] DELETE /identity/v3/projects/14ea91ce2fe14c2083a08eb3f95fad0b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:04.067954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1243-d86c-4fee-a969-03376eba61f3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.068233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1243-d86c-4fee-a969-03376eba61f3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.068511 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1243-d86c-4fee-a969-03376eba61f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.101827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3e9c1243-d86c-4fee-a969-03376eba61f3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:04.103535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3e9c1243-d86c-4fee-a969-03376eba61f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:04.112261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35f690-e078-489f-8e7f-98dfef85b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:04.112896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35f690-e078-489f-8e7f-98dfef85b8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.113252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35f690-e078-489f-8e7f-98dfef85b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.113524 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35f690-e078-489f-8e7f-98dfef85b8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.114165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35f690-e078-489f-8e7f-98dfef85b8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:04.115981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35f690-e078-489f-8e7f-98dfef85b8f6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:04.136506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 922/1835] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:04.140948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35f690-e078-489f-8e7f-98dfef85b8f6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:04.145601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2e35f690-e078-489f-8e7f-98dfef85b8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:04.165965 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35f690-e078-489f-8e7f-98dfef85b8f6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:04.180299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ad071-9631-48b3-80bd-26a972fa0d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:04.181248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ad071-9631-48b3-80bd-26a972fa0d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.183565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ad071-9631-48b3-80bd-26a972fa0d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.183996 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ad071-9631-48b3-80bd-26a972fa0d97 admin admin] PATH_INFO: `/v3/projects/023155ba0e164607bbf31b665f476a77/users/95fb2d8e80754f88b0c79dacc4de986e/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.214971 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:04.219620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ad071-9631-48b3-80bd-26a972fa0d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023155ba0e164607bbf31b665f476a77, user_id=95fb2d8e80754f88b0c79dacc4de986e, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:04.241536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ad071-9631-48b3-80bd-26a972fa0d97 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:04.269223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 923/1836] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:04 2022] PUT /identity/v3/projects/023155ba0e164607bbf31b665f476a77/users/95fb2d8e80754f88b0c79dacc4de986e/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:04.280824 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f830c-6e77-4962-b9a2-babe2a9d04b1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.281153 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f830c-6e77-4962-b9a2-babe2a9d04b1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.281457 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f830c-6e77-4962-b9a2-babe2a9d04b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.293210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 914/1837] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:04.302224 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba15808-d79b-4b60-8188-c88b5cf3ac4d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.302854 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba15808-d79b-4b60-8188-c88b5cf3ac4d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.303280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba15808-d79b-4b60-8188-c88b5cf3ac4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.316202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-117f830c-6e77-4962-b9a2-babe2a9d04b1 None None] MFA Rules not processed for user `95fb2d8e80754f88b0c79dacc4de986e`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:04.317565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-117f830c-6e77-4962-b9a2-babe2a9d04b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:04.344937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cba15808-d79b-4b60-8188-c88b5cf3ac4d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:04.348846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cba15808-d79b-4b60-8188-c88b5cf3ac4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:04.428521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 924/1838] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:04.443003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f830c-6e77-4962-b9a2-babe2a9d04b1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:04.444305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-117f830c-6e77-4962-b9a2-babe2a9d04b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:04.482763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 915/1839] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:04.484564 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba15808-d79b-4b60-8188-c88b5cf3ac4d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:04.505278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba15808-d79b-4b60-8188-c88b5cf3ac4d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:04.514540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ce64a-40a8-4119-bb46-407c6e4e5955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:04.516845 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ce64a-40a8-4119-bb46-407c6e4e5955 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.517184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ce64a-40a8-4119-bb46-407c6e4e5955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.517499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ce64a-40a8-4119-bb46-407c6e4e5955 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.518175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ce64a-40a8-4119-bb46-407c6e4e5955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:04.518670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ce64a-40a8-4119-bb46-407c6e4e5955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:04.521099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f830c-6e77-4962-b9a2-babe2a9d04b1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:04.524997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ce64a-40a8-4119-bb46-407c6e4e5955 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:04.526287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e59ed-c262-44d5-b8ec-7b60b8a2c258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:04.527093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e59ed-c262-44d5-b8ec-7b60b8a2c258 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.527535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e59ed-c262-44d5-b8ec-7b60b8a2c258 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.527960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e59ed-c262-44d5-b8ec-7b60b8a2c258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.538379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e59ed-c262-44d5-b8ec-7b60b8a2c258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:04.540410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e59ed-c262-44d5-b8ec-7b60b8a2c258 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:04.551046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 916/1840] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:04.555570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ce64a-40a8-4119-bb46-407c6e4e5955 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:04.558022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 925/1841] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:28:04.576017 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ce64a-40a8-4119-bb46-407c6e4e5955 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:04.593240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9f333-525b-4c10-a92a-22b7e2843279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:04.593240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9f333-525b-4c10-a92a-22b7e2843279 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.593240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9f333-525b-4c10-a92a-22b7e2843279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.593240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9f333-525b-4c10-a92a-22b7e2843279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.593672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9f333-525b-4c10-a92a-22b7e2843279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:04.598224 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9f333-525b-4c10-a92a-22b7e2843279 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:04.610698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e59ed-c262-44d5-b8ec-7b60b8a2c258 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:04.626273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e59ed-c262-44d5-b8ec-7b60b8a2c258 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:04.640984 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:04.644164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.645469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.647233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] PATH_INFO: `/v3/users/95fb2d8e80754f88b0c79dacc4de986e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.649661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fb2d8e80754f88b0c79dacc4de986e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:04.660397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 917/1842] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:04 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:04.661433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:04.664191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9f333-525b-4c10-a92a-22b7e2843279 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:04.754202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fb2d8e80754f88b0c79dacc4de986e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:04.755110 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fb2d8e80754f88b0c79dacc4de986e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:04.780822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fb2d8e80754f88b0c79dacc4de986e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:04.785698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fb2d8e80754f88b0c79dacc4de986e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:04.815561 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f7df6270-c1bb-4c01-8ed2-875841c0296f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fb2d8e80754f88b0c79dacc4de986e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:04.823949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:04.845047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 926/1843] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:04 2022] DELETE /identity/v3/users/95fb2d8e80754f88b0c79dacc4de986e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:04.850821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3df0a-e48e-481e-acf2-010421dfd3f6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.851434 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9f333-525b-4c10-a92a-22b7e2843279 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:04.851752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3df0a-e48e-481e-acf2-010421dfd3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.852187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3df0a-e48e-481e-acf2-010421dfd3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.859215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:04.884190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e2e3df0a-e48e-481e-acf2-010421dfd3f6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:04.886755 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e2e3df0a-e48e-481e-acf2-010421dfd3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:04.941212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457d389-e28a-4704-b2de-0bb1684a16f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:04.942833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457d389-e28a-4704-b2de-0bb1684a16f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:04.943193 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457d389-e28a-4704-b2de-0bb1684a16f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:04.943551 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457d389-e28a-4704-b2de-0bb1684a16f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:04.945024 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457d389-e28a-4704-b2de-0bb1684a16f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:04.947203 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457d389-e28a-4704-b2de-0bb1684a16f8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:04.996409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 918/1844] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:04 2022] POST /identity/v3/users => generated 282 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:04.999798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457d389-e28a-4704-b2de-0bb1684a16f8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:05.005620 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a457d389-e28a-4704-b2de-0bb1684a16f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:05.020385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 927/1845] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:05.032382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3df0a-e48e-481e-acf2-010421dfd3f6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:05.035197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457d389-e28a-4704-b2de-0bb1684a16f8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:05.040019 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e2e3df0a-e48e-481e-acf2-010421dfd3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:05.041280 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065160f-e44e-44a1-ae5e-ce93d93c3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:05.042281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065160f-e44e-44a1-ae5e-ce93d93c3e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.042708 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065160f-e44e-44a1-ae5e-ce93d93c3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.043163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065160f-e44e-44a1-ae5e-ce93d93c3e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.044665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065160f-e44e-44a1-ae5e-ce93d93c3e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:05.046958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065160f-e44e-44a1-ae5e-ce93d93c3e0f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:05.063807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 919/1846] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:28:05.065945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065160f-e44e-44a1-ae5e-ce93d93c3e0f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:05.078642 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065160f-e44e-44a1-ae5e-ce93d93c3e0f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:05.085746 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd3d65-c7c4-4bab-9928-24643220a74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:05.087003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3d65-c7c4-4bab-9928-24643220a74e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.087278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3d65-c7c4-4bab-9928-24643220a74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.087547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3d65-c7c4-4bab-9928-24643220a74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.088190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd3d65-c7c4-4bab-9928-24643220a74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:05.090273 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd3d65-c7c4-4bab-9928-24643220a74e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:05.103926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 920/1847] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:05.108118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd3d65-c7c4-4bab-9928-24643220a74e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:05.120364 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd3d65-c7c4-4bab-9928-24643220a74e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:05.136440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb88e2-6790-4877-b73e-c683559e185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:05.137163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb88e2-6790-4877-b73e-c683559e185b admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.137439 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb88e2-6790-4877-b73e-c683559e185b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.137711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb88e2-6790-4877-b73e-c683559e185b admin admin] PATH_INFO: `/v3/projects/cde49dd8ea4b41f281576aa4236515ee/users/515e76e494354c068bb4df6540a9f07d/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.167028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3df0a-e48e-481e-acf2-010421dfd3f6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:05.169106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb88e2-6790-4877-b73e-c683559e185b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde49dd8ea4b41f281576aa4236515ee, user_id=515e76e494354c068bb4df6540a9f07d, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:05.172316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1d30c-7273-41bd-876e-7fcee8cda524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:05.172966 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d30c-7273-41bd-876e-7fcee8cda524 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.173275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d30c-7273-41bd-876e-7fcee8cda524 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.173557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d30c-7273-41bd-876e-7fcee8cda524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.176570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb88e2-6790-4877-b73e-c683559e185b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:05.200478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 921/1848] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:05 2022] PUT /identity/v3/projects/cde49dd8ea4b41f281576aa4236515ee/users/515e76e494354c068bb4df6540a9f07d/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:05.206714 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1d30c-7273-41bd-876e-7fcee8cda524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:05.208740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1d30c-7273-41bd-876e-7fcee8cda524 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:05.213448 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4efa1-c961-4dcf-b601-ad051e503e5f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.213745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4efa1-c961-4dcf-b601-ad051e503e5f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.214013 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4efa1-c961-4dcf-b601-ad051e503e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.225139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 928/1849] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:28:05.256828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-caf4efa1-c961-4dcf-b601-ad051e503e5f None None] MFA Rules not processed for user `515e76e494354c068bb4df6540a9f07d`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:05.258114 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-caf4efa1-c961-4dcf-b601-ad051e503e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:05.344150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1d30c-7273-41bd-876e-7fcee8cda524 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:05.346816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e9d1d30c-7273-41bd-876e-7fcee8cda524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:05.349690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 922/1850] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:05.361835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4efa1-c961-4dcf-b601-ad051e503e5f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:05.363464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-caf4efa1-c961-4dcf-b601-ad051e503e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:05.364676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1d30c-7273-41bd-876e-7fcee8cda524 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:05.456362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:05.472735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4efa1-c961-4dcf-b601-ad051e503e5f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:05.475399 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:05.476372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.477103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a35157-d999-437d-abe3-e686bcef4f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:05.477498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.477714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a35157-d999-437d-abe3-e686bcef4f94 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.477990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a35157-d999-437d-abe3-e686bcef4f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.478258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a35157-d999-437d-abe3-e686bcef4f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.478745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] PATH_INFO: `/v3/users/2c14e674e8474aed8ed003fddf3b4379` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.480374 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c14e674e8474aed8ed003fddf3b4379)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:05.483229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:05.487975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a35157-d999-437d-abe3-e686bcef4f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:05.490550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a35157-d999-437d-abe3-e686bcef4f94 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:05.509457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 923/1851] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:28:05.592090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a35157-d999-437d-abe3-e686bcef4f94 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:05.594125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d7a35157-d999-437d-abe3-e686bcef4f94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:05.648167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:05.676096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a35157-d999-437d-abe3-e686bcef4f94 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:05.678609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c14e674e8474aed8ed003fddf3b4379'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:05.679303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c14e674e8474aed8ed003fddf3b4379'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:05.682940 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:05.684373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.684856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.685359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] PATH_INFO: `/v3/projects/023155ba0e164607bbf31b665f476a77` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.687611 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=023155ba0e164607bbf31b665f476a77)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:05.690277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:05.690868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c14e674e8474aed8ed003fddf3b4379'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:05.693435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c14e674e8474aed8ed003fddf3b4379'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:05.729708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-095ecbdf-abc1-438a-a2c4-e12d64055d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c14e674e8474aed8ed003fddf3b4379'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:05.756482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 929/1852] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:05 2022] DELETE /identity/v3/users/2c14e674e8474aed8ed003fddf3b4379 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:05.761416 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32550a8-7623-4b49-ae87-32bc93d18b4a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.762206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32550a8-7623-4b49-ae87-32bc93d18b4a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.762738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32550a8-7623-4b49-ae87-32bc93d18b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.795746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c32550a8-7623-4b49-ae87-32bc93d18b4a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:05.797126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c32550a8-7623-4b49-ae87-32bc93d18b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:05.800160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023155ba0e164607bbf31b665f476a77', 'request_id': 'req-f758c065-62af-4699-aff1-c187cc8c46f7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:05.813773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023155ba0e164607bbf31b665f476a77', 'request_id': 'req-f758c065-62af-4699-aff1-c187cc8c46f7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:05.831183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023155ba0e164607bbf31b665f476a77', 'request_id': 'req-f758c065-62af-4699-aff1-c187cc8c46f7'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:05.854595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] The token cache is being invalidate because project 023155ba0e164607bbf31b665f476a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:05.857583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:05.859056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f758c065-62af-4699-aff1-c187cc8c46f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:05.861912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 924/1853] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:05 2022] DELETE /identity/v3/projects/023155ba0e164607bbf31b665f476a77 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:05.866357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ca4d-e943-4d91-810b-1b66e0c328a6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.866644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ca4d-e943-4d91-810b-1b66e0c328a6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.866961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ca4d-e943-4d91-810b-1b66e0c328a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.918894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-13f8ca4d-e943-4d91-810b-1b66e0c328a6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:05.920127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-13f8ca4d-e943-4d91-810b-1b66e0c328a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:05.931345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 925/1854] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:05.938909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 930/1855] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:05.939179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294f57-64e6-429e-9879-c955d4a8c54e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:05.940067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294f57-64e6-429e-9879-c955d4a8c54e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:05.940354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294f57-64e6-429e-9879-c955d4a8c54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:05.949045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32550a8-7623-4b49-ae87-32bc93d18b4a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:05.950987 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c32550a8-7623-4b49-ae87-32bc93d18b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:05.987784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-94294f57-64e6-429e-9879-c955d4a8c54e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:05.988826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-94294f57-64e6-429e-9879-c955d4a8c54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:06.004038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 926/1856] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:06.009521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294f57-64e6-429e-9879-c955d4a8c54e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:06.024434 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294f57-64e6-429e-9879-c955d4a8c54e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:06.032903 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870abae-ef42-49c2-b318-5733ed8b0a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:06.034169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870abae-ef42-49c2-b318-5733ed8b0a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.034761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870abae-ef42-49c2-b318-5733ed8b0a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.035270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870abae-ef42-49c2-b318-5733ed8b0a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.036118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870abae-ef42-49c2-b318-5733ed8b0a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:06.036469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870abae-ef42-49c2-b318-5733ed8b0a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:06.038564 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870abae-ef42-49c2-b318-5733ed8b0a02 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:06.060689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 927/1857] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:06.061902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870abae-ef42-49c2-b318-5733ed8b0a02 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:06.085250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870abae-ef42-49c2-b318-5733ed8b0a02 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:06.093743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f0007-7290-4263-81d5-0de64d7b75a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:06.094462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f0007-7290-4263-81d5-0de64d7b75a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.101342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f0007-7290-4263-81d5-0de64d7b75a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.101695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f0007-7290-4263-81d5-0de64d7b75a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.102389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f0007-7290-4263-81d5-0de64d7b75a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:06.104321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f0007-7290-4263-81d5-0de64d7b75a6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:06.106488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32550a8-7623-4b49-ae87-32bc93d18b4a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:06.120267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6a593-6543-40b3-a271-45653b0fa393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:06.121104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6a593-6543-40b3-a271-45653b0fa393 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.121543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6a593-6543-40b3-a271-45653b0fa393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.122042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6a593-6543-40b3-a271-45653b0fa393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.198938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6a593-6543-40b3-a271-45653b0fa393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:06.200494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6a593-6543-40b3-a271-45653b0fa393 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:06.204510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 928/1858] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:06 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:06.208876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f0007-7290-4263-81d5-0de64d7b75a6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:06.221643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 931/1859] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:06.352395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f0007-7290-4263-81d5-0de64d7b75a6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:06.370658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df65dc-ff29-4428-b0c2-3af347589cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:06.371636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df65dc-ff29-4428-b0c2-3af347589cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.372105 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df65dc-ff29-4428-b0c2-3af347589cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.372807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df65dc-ff29-4428-b0c2-3af347589cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.373573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df65dc-ff29-4428-b0c2-3af347589cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:06.378752 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df65dc-ff29-4428-b0c2-3af347589cf7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:06.414107 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 929/1860] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:06 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:06.418883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6a593-6543-40b3-a271-45653b0fa393 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:06.444056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6a593-6543-40b3-a271-45653b0fa393 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:06.460023 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b53983-b3d5-474a-ba0f-0a2b74f4b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:06.460711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53983-b3d5-474a-ba0f-0a2b74f4b12d admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.460919 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53983-b3d5-474a-ba0f-0a2b74f4b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.461206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53983-b3d5-474a-ba0f-0a2b74f4b12d admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.464967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b53983-b3d5-474a-ba0f-0a2b74f4b12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:06.466672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b53983-b3d5-474a-ba0f-0a2b74f4b12d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:06.482463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 932/1861] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:06.488487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df65dc-ff29-4428-b0c2-3af347589cf7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:06.499621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df65dc-ff29-4428-b0c2-3af347589cf7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:06.507152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284984-9774-404d-bd16-eac5bc4f6331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:06.508883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284984-9774-404d-bd16-eac5bc4f6331 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.510464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284984-9774-404d-bd16-eac5bc4f6331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.511137 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284984-9774-404d-bd16-eac5bc4f6331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.512881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d284984-9774-404d-bd16-eac5bc4f6331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:06.519259 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d284984-9774-404d-bd16-eac5bc4f6331 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:06.524583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:06.559706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b53983-b3d5-474a-ba0f-0a2b74f4b12d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:06.574217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 930/1862] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:28:06.582942 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b53983-b3d5-474a-ba0f-0a2b74f4b12d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:06.590216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677abeed-f5e1-4c12-9089-ddaec113d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:06.591539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677abeed-f5e1-4c12-9089-ddaec113d138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.592116 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677abeed-f5e1-4c12-9089-ddaec113d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.592534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677abeed-f5e1-4c12-9089-ddaec113d138 admin admin] PATH_INFO: `/v3/projects/e6f904d22d4244988c509875e4a7bc73/users/977979e33b244cf8aceff6eddc8653b4/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.645189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677abeed-f5e1-4c12-9089-ddaec113d138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f904d22d4244988c509875e4a7bc73, user_id=977979e33b244cf8aceff6eddc8653b4, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:06.649377 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677abeed-f5e1-4c12-9089-ddaec113d138 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:06.674731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 933/1863] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:06 2022] PUT /identity/v3/projects/e6f904d22d4244988c509875e4a7bc73/users/977979e33b244cf8aceff6eddc8653b4/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:06.677118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfc6d-887e-42fd-847a-6ce568d41a73 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.677646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfc6d-887e-42fd-847a-6ce568d41a73 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.678139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfc6d-887e-42fd-847a-6ce568d41a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.709139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-2e6dfc6d-887e-42fd-847a-6ce568d41a73 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:06.711066 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2e6dfc6d-887e-42fd-847a-6ce568d41a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:06.739568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677abeed-f5e1-4c12-9089-ddaec113d138 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:06.747026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-677abeed-f5e1-4c12-9089-ddaec113d138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:06.821220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:06.883386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 931/1864] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:06.898934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677abeed-f5e1-4c12-9089-ddaec113d138 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:06.900702 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dfc6d-887e-42fd-847a-6ce568d41a73 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:06.919648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:06.920838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:06.921252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:06.921630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] PATH_INFO: `/v3/projects/e6272b4d8b8a4599aedbf3cc58f104e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:06.923171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6272b4d8b8a4599aedbf3cc58f104e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:06.927036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:06.998523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6272b4d8b8a4599aedbf3cc58f104e5', 'request_id': 'req-036f0fb1-c0ab-4763-b686-8c0be0ec479d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.007203 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dfc6d-887e-42fd-847a-6ce568d41a73 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:07.007706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6272b4d8b8a4599aedbf3cc58f104e5', 'request_id': 'req-036f0fb1-c0ab-4763-b686-8c0be0ec479d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.016348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6272b4d8b8a4599aedbf3cc58f104e5', 'request_id': 'req-036f0fb1-c0ab-4763-b686-8c0be0ec479d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.030619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] The token cache is being invalidate because project e6272b4d8b8a4599aedbf3cc58f104e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:07.030947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.031607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.033536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 934/1865] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:06 2022] DELETE /identity/v3/projects/e6272b4d8b8a4599aedbf3cc58f104e5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:07.039105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:07.041146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:07.094153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc141f-6903-46e6-ba5e-c7338d5a0229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:07.094771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc141f-6903-46e6-ba5e-c7338d5a0229 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:07.095049 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc141f-6903-46e6-ba5e-c7338d5a0229 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:07.095902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc141f-6903-46e6-ba5e-c7338d5a0229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:07.097977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aacc141f-6903-46e6-ba5e-c7338d5a0229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:07.125218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f0fb1-c0ab-4763-b686-8c0be0ec479d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:07.130630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:07.131474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:07.131712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:07.132022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] PATH_INFO: `/v3/users/4f78884b72154364a6da17962f23fd80` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:07.133230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f78884b72154364a6da17962f23fd80)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:07.135210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:07.166357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc141f-6903-46e6-ba5e-c7338d5a0229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:07.167994 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc141f-6903-46e6-ba5e-c7338d5a0229 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:07.179564 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 932/1866] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:28:07.180425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc141f-6903-46e6-ba5e-c7338d5a0229 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:07.181900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aacc141f-6903-46e6-ba5e-c7338d5a0229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:07.193254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:07.210184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc141f-6903-46e6-ba5e-c7338d5a0229 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:07.215038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f78884b72154364a6da17962f23fd80'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.216049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f78884b72154364a6da17962f23fd80'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.216365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44526100-4884-4781-9825-a6433a133054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:07.218861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44526100-4884-4781-9825-a6433a133054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:07.218861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44526100-4884-4781-9825-a6433a133054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:07.218861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44526100-4884-4781-9825-a6433a133054 admin admin] PATH_INFO: `/v3/users/855713a466914a84bd3697a308a8ed20` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:07.220143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44526100-4884-4781-9825-a6433a133054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855713a466914a84bd3697a308a8ed20)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:07.222869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44526100-4884-4781-9825-a6433a133054 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:07.232554 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f78884b72154364a6da17962f23fd80'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.245610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f78884b72154364a6da17962f23fd80'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.245610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:07.258437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f78884b72154364a6da17962f23fd80'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.280674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 935/1867] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:07 2022] DELETE /identity/v3/users/4f78884b72154364a6da17962f23fd80 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:07.306750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-44526100-4884-4781-9825-a6433a133054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855713a466914a84bd3697a308a8ed20'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.324058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-44526100-4884-4781-9825-a6433a133054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855713a466914a84bd3697a308a8ed20'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.324890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-44526100-4884-4781-9825-a6433a133054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855713a466914a84bd3697a308a8ed20'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.364686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-44526100-4884-4781-9825-a6433a133054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855713a466914a84bd3697a308a8ed20'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.387955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-44526100-4884-4781-9825-a6433a133054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855713a466914a84bd3697a308a8ed20'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:07.424937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 933/1868] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:07 2022] DELETE /identity/v3/users/855713a466914a84bd3697a308a8ed20 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:07.668202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:07.681040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:07.826307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2de8-81cc-475c-9f65-e3f37af1165a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:07.971266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:07.972034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:07.972567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:07.972847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] PATH_INFO: `/v3/projects/f192c9b5c1914bf8bac054309980e1b5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:07.976954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f192c9b5c1914bf8bac054309980e1b5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:07.980836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:07.983465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44526100-4884-4781-9825-a6433a133054 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:07.985398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-44526100-4884-4781-9825-a6433a133054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:08.031308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44526100-4884-4781-9825-a6433a133054 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.046579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.049198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.049812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.052643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] PATH_INFO: `/v3/projects/1655c89ebf9140cbb88bb506f99b6eb0` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.057190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1655c89ebf9140cbb88bb506f99b6eb0)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.062558 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.112391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f192c9b5c1914bf8bac054309980e1b5', 'request_id': 'req-8981c9fc-9b04-46cd-867f-edc292c51050'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:08.120415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f192c9b5c1914bf8bac054309980e1b5', 'request_id': 'req-8981c9fc-9b04-46cd-867f-edc292c51050'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:08.137965 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f192c9b5c1914bf8bac054309980e1b5', 'request_id': 'req-8981c9fc-9b04-46cd-867f-edc292c51050'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:08.162329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] The token cache is being invalidate because project f192c9b5c1914bf8bac054309980e1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:08.162624 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:08.165445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8981c9fc-9b04-46cd-867f-edc292c51050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:08.169523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 936/1869] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:07 2022] DELETE /identity/v3/projects/f192c9b5c1914bf8bac054309980e1b5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:08.175326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375295f-6d40-4545-9a0c-7887fa6f989a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.175611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375295f-6d40-4545-9a0c-7887fa6f989a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.175891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375295f-6d40-4545-9a0c-7887fa6f989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.228423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1655c89ebf9140cbb88bb506f99b6eb0', 'request_id': 'req-238281b4-e2f6-43f0-a3f9-82194eaefb65'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:08.228933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6375295f-6d40-4545-9a0c-7887fa6f989a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:08.233422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6375295f-6d40-4545-9a0c-7887fa6f989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:08.246649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1655c89ebf9140cbb88bb506f99b6eb0', 'request_id': 'req-238281b4-e2f6-43f0-a3f9-82194eaefb65'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:08.258299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1655c89ebf9140cbb88bb506f99b6eb0', 'request_id': 'req-238281b4-e2f6-43f0-a3f9-82194eaefb65'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:08.266724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:08.280070 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] The token cache is being invalidate because project 1655c89ebf9140cbb88bb506f99b6eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:08.280361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:08.285155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-238281b4-e2f6-43f0-a3f9-82194eaefb65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:08.292029 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 934/1870] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:07 2022] DELETE /identity/v3/projects/1655c89ebf9140cbb88bb506f99b6eb0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:08.309104 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b92e7-b6a2-4302-9cc9-6d229328897e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.309390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b92e7-b6a2-4302-9cc9-6d229328897e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.309663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b92e7-b6a2-4302-9cc9-6d229328897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.369936 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e05b92e7-b6a2-4302-9cc9-6d229328897e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:08.371133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e05b92e7-b6a2-4302-9cc9-6d229328897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:08.378530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 937/1871] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:08.380506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e5e0-0b83-4103-8357-c3e6d3464660 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.381486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e5e0-0b83-4103-8357-c3e6d3464660 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.381486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e5e0-0b83-4103-8357-c3e6d3464660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.402676 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 935/1872] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:08.404687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ffed9-fe0e-4448-a1e3-432975228682 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.404970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ffed9-fe0e-4448-a1e3-432975228682 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.405276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ffed9-fe0e-4448-a1e3-432975228682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.430913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4522e5e0-0b83-4103-8357-c3e6d3464660 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:08.432471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4522e5e0-0b83-4103-8357-c3e6d3464660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:08.452096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 938/1873] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:08.453048 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e5e0-0b83-4103-8357-c3e6d3464660 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.466519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e5e0-0b83-4103-8357-c3e6d3464660 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.467646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-fa8ffed9-fe0e-4448-a1e3-432975228682 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:08.472953 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fa8ffed9-fe0e-4448-a1e3-432975228682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:08.473786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a819f89-e551-49d0-b0d3-5e3f8aadd475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.474729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a819f89-e551-49d0-b0d3-5e3f8aadd475 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.475007 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a819f89-e551-49d0-b0d3-5e3f8aadd475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.475274 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a819f89-e551-49d0-b0d3-5e3f8aadd475 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.475976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a819f89-e551-49d0-b0d3-5e3f8aadd475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:08.476286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a819f89-e551-49d0-b0d3-5e3f8aadd475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.477985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a819f89-e551-49d0-b0d3-5e3f8aadd475 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.497505 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 936/1874] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:08.499248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ffed9-fe0e-4448-a1e3-432975228682 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.504436 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 939/1875] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:08.509308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a819f89-e551-49d0-b0d3-5e3f8aadd475 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.515838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ffed9-fe0e-4448-a1e3-432975228682 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.530252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a819f89-e551-49d0-b0d3-5e3f8aadd475 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.536952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564ae52-6799-4359-9399-c3b5e992d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.539144 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564ae52-6799-4359-9399-c3b5e992d44b admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.540310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564ae52-6799-4359-9399-c3b5e992d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.540781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564ae52-6799-4359-9399-c3b5e992d44b admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.540950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6118981-2999-4e98-897d-21733f24b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.541620 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6118981-2999-4e98-897d-21733f24b468 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.541897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6118981-2999-4e98-897d-21733f24b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.542164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6118981-2999-4e98-897d-21733f24b468 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.542410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564ae52-6799-4359-9399-c3b5e992d44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.542821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6118981-2999-4e98-897d-21733f24b468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:08.543118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6118981-2999-4e98-897d-21733f24b468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.545504 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564ae52-6799-4359-9399-c3b5e992d44b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.545929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6118981-2999-4e98-897d-21733f24b468 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.573584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 937/1876] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:08.575626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544151-179c-4f74-a3da-3c47530bb97f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.576028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544151-179c-4f74-a3da-3c47530bb97f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.576380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544151-179c-4f74-a3da-3c47530bb97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.589375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 940/1877] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:08 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:08.591547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564ae52-6799-4359-9399-c3b5e992d44b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.609126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-58544151-179c-4f74-a3da-3c47530bb97f None None] MFA Rules not processed for user `977979e33b244cf8aceff6eddc8653b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:08.610392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-58544151-179c-4f74-a3da-3c47530bb97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:08.636077 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:08.677501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564ae52-6799-4359-9399-c3b5e992d44b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.682529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcdfba-4c03-4201-ad4d-5529f9119b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.683977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcdfba-4c03-4201-ad4d-5529f9119b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.684283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcdfba-4c03-4201-ad4d-5529f9119b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.684536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcdfba-4c03-4201-ad4d-5529f9119b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.685408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcdfba-4c03-4201-ad4d-5529f9119b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.687443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcdfba-4c03-4201-ad4d-5529f9119b63 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.692639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 938/1878] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:08.693684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58544151-179c-4f74-a3da-3c47530bb97f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.707555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58544151-179c-4f74-a3da-3c47530bb97f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.712699 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6281d88-04fe-4e4c-906b-af91b6f69357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.713345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6281d88-04fe-4e4c-906b-af91b6f69357 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.713630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6281d88-04fe-4e4c-906b-af91b6f69357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.713900 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6281d88-04fe-4e4c-906b-af91b6f69357 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.714663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6281d88-04fe-4e4c-906b-af91b6f69357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.716842 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6281d88-04fe-4e4c-906b-af91b6f69357 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.724224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 941/1879] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:08 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:08.729145 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcdfba-4c03-4201-ad4d-5529f9119b63 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.731489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7ddcdfba-4c03-4201-ad4d-5529f9119b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:08.741651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 939/1880] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:08 2022] POST /identity/v3/users => generated 284 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:08.742606 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6281d88-04fe-4e4c-906b-af91b6f69357 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.753939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6281d88-04fe-4e4c-906b-af91b6f69357 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.805997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcdfba-4c03-4201-ad4d-5529f9119b63 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.810154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5c95b-bb13-45b3-a3db-bf6ecc3b0068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.810841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5c95b-bb13-45b3-a3db-bf6ecc3b0068 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.811190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5c95b-bb13-45b3-a3db-bf6ecc3b0068 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.811533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5c95b-bb13-45b3-a3db-bf6ecc3b0068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.822990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:08.826671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eff31-84a8-463b-af60-210f013bae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.827363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eff31-84a8-463b-af60-210f013bae03 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.827703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eff31-84a8-463b-af60-210f013bae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.828130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eff31-84a8-463b-af60-210f013bae03 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.828730 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eff31-84a8-463b-af60-210f013bae03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.832267 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4eff31-84a8-463b-af60-210f013bae03 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.860484 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 940/1881] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:08 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:08.864711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eff31-84a8-463b-af60-210f013bae03 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.874775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eff31-84a8-463b-af60-210f013bae03 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.882341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95947c-08a2-4a47-bc54-bcc914d03d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.882954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95947c-08a2-4a47-bc54-bcc914d03d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.883328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95947c-08a2-4a47-bc54-bcc914d03d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.883497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95947c-08a2-4a47-bc54-bcc914d03d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.884024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5c95b-bb13-45b3-a3db-bf6ecc3b0068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.884134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95947c-08a2-4a47-bc54-bcc914d03d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.885523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5c95b-bb13-45b3-a3db-bf6ecc3b0068 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.885755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95947c-08a2-4a47-bc54-bcc914d03d65 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.895512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 942/1882] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:08.896359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5c95b-bb13-45b3-a3db-bf6ecc3b0068 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.900386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 941/1883] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:08.903959 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95947c-08a2-4a47-bc54-bcc914d03d65 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.910345 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5c95b-bb13-45b3-a3db-bf6ecc3b0068 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.915677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95947c-08a2-4a47-bc54-bcc914d03d65 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.917453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa730ff9-db20-4fc9-84e4-bfc096779bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.918068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa730ff9-db20-4fc9-84e4-bfc096779bec admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.918344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa730ff9-db20-4fc9-84e4-bfc096779bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.918611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa730ff9-db20-4fc9-84e4-bfc096779bec admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.919329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa730ff9-db20-4fc9-84e4-bfc096779bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.920974 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa730ff9-db20-4fc9-84e4-bfc096779bec admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.921145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4266a-7867-41cd-9e8b-4737b0b54518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.921799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4266a-7867-41cd-9e8b-4737b0b54518 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.922075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4266a-7867-41cd-9e8b-4737b0b54518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.922345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4266a-7867-41cd-9e8b-4737b0b54518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.922980 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4266a-7867-41cd-9e8b-4737b0b54518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.924731 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4266a-7867-41cd-9e8b-4737b0b54518 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.931719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 943/1884] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:08.935503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa730ff9-db20-4fc9-84e4-bfc096779bec admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.935836 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 942/1885] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:08.941566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4266a-7867-41cd-9e8b-4737b0b54518 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.949672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa730ff9-db20-4fc9-84e4-bfc096779bec admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.952369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4266a-7867-41cd-9e8b-4737b0b54518 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.955524 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539051-3c59-47b1-a573-3c9709b6ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.956509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539051-3c59-47b1-a573-3c9709b6ba7c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.956806 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539051-3c59-47b1-a573-3c9709b6ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.957202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539051-3c59-47b1-a573-3c9709b6ba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.957792 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1009568-e792-469c-b5b3-39d487c746f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.958041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539051-3c59-47b1-a573-3c9709b6ba7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.958422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1009568-e792-469c-b5b3-39d487c746f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.958696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1009568-e792-469c-b5b3-39d487c746f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.958965 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1009568-e792-469c-b5b3-39d487c746f6 admin admin] PATH_INFO: `/v3/projects/1e283e21b3b54897a9df3f65062b43ff/users/bcc509e3dcc6402e993651a143d1011c/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.960019 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539051-3c59-47b1-a573-3c9709b6ba7c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.973176 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 944/1886] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:28:08.975803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1009568-e792-469c-b5b3-39d487c746f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e283e21b3b54897a9df3f65062b43ff, user_id=bcc509e3dcc6402e993651a143d1011c, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:08.976076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539051-3c59-47b1-a573-3c9709b6ba7c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:08.980924 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1009568-e792-469c-b5b3-39d487c746f6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:08.987266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539051-3c59-47b1-a573-3c9709b6ba7c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:08.993486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2caa95-2384-4d1a-8afa-489f52336250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:08.994305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2caa95-2384-4d1a-8afa-489f52336250 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:08.994845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2caa95-2384-4d1a-8afa-489f52336250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:08.995128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2caa95-2384-4d1a-8afa-489f52336250 admin admin] PATH_INFO: `/v3/projects/e7bf35a9a4824b058a711aeaf1a94259/users/44ce7f02d9e749e5a0f47bff1fcc1886/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:08.998710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 943/1887] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:08 2022] PUT /identity/v3/projects/1e283e21b3b54897a9df3f65062b43ff/users/bcc509e3dcc6402e993651a143d1011c/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:09.010026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43225-1fab-42ea-9318-abc59f74c17e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.010302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43225-1fab-42ea-9318-abc59f74c17e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.010573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43225-1fab-42ea-9318-abc59f74c17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.022379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2caa95-2384-4d1a-8afa-489f52336250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7bf35a9a4824b058a711aeaf1a94259, user_id=44ce7f02d9e749e5a0f47bff1fcc1886, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.025339 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2caa95-2384-4d1a-8afa-489f52336250 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.044666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-91f43225-1fab-42ea-9318-abc59f74c17e None None] MFA Rules not processed for user `bcc509e3dcc6402e993651a143d1011c`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:09.045201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 945/1888] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:08 2022] PUT /identity/v3/projects/e7bf35a9a4824b058a711aeaf1a94259/users/44ce7f02d9e749e5a0f47bff1fcc1886/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:09.045830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-91f43225-1fab-42ea-9318-abc59f74c17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:09.055091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c0cec-9255-46c0-b329-3aea1bd5c962 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.055459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c0cec-9255-46c0-b329-3aea1bd5c962 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.055878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c0cec-9255-46c0-b329-3aea1bd5c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.091029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c89c0cec-9255-46c0-b329-3aea1bd5c962 None None] MFA Rules not processed for user `44ce7f02d9e749e5a0f47bff1fcc1886`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:09.092800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c89c0cec-9255-46c0-b329-3aea1bd5c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:09.103582 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:09.146604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 944/1889] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:09.153353 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f43225-1fab-42ea-9318-abc59f74c17e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.202126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 946/1890] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:09.209500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c0cec-9255-46c0-b329-3aea1bd5c962 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.273707 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f43225-1fab-42ea-9318-abc59f74c17e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.279983 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7763f-793f-40c1-a60d-473af968e4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.280612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7763f-793f-40c1-a60d-473af968e4da admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.280935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7763f-793f-40c1-a60d-473af968e4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.281357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7763f-793f-40c1-a60d-473af968e4da admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.282003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7763f-793f-40c1-a60d-473af968e4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.285414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7763f-793f-40c1-a60d-473af968e4da admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.333278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 945/1891] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:09 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:09.338086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7763f-793f-40c1-a60d-473af968e4da admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.339466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:09.352435 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c0cec-9255-46c0-b329-3aea1bd5c962 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.424335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7763f-793f-40c1-a60d-473af968e4da admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.430617 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7dc7-9a30-4d8b-a643-d22607d88da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.431382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7dc7-9a30-4d8b-a643-d22607d88da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.431667 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7dc7-9a30-4d8b-a643-d22607d88da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.431942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7dc7-9a30-4d8b-a643-d22607d88da7 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.432573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f7dc7-9a30-4d8b-a643-d22607d88da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.433860 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b7ad1-f521-4f63-b613-52efb98f7544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.434536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b7ad1-f521-4f63-b613-52efb98f7544 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.435008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b7ad1-f521-4f63-b613-52efb98f7544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.435233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b7ad1-f521-4f63-b613-52efb98f7544 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.435657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f7dc7-9a30-4d8b-a643-d22607d88da7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.438903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b7ad1-f521-4f63-b613-52efb98f7544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.438903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b7ad1-f521-4f63-b613-52efb98f7544 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.465663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 946/1892] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:09 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:09.467026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7dc7-9a30-4d8b-a643-d22607d88da7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.469202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 947/1893] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:09 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:09.473524 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b7ad1-f521-4f63-b613-52efb98f7544 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.478744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7dc7-9a30-4d8b-a643-d22607d88da7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.528460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:09.540798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e415db8-358e-49df-bcc7-319fb4bd5ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.541433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e415db8-358e-49df-bcc7-319fb4bd5ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.541765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e415db8-358e-49df-bcc7-319fb4bd5ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.542046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e415db8-358e-49df-bcc7-319fb4bd5ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.542681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e415db8-358e-49df-bcc7-319fb4bd5ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.544270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e415db8-358e-49df-bcc7-319fb4bd5ec7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.549398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b7ad1-f521-4f63-b613-52efb98f7544 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.554864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099950f6-c074-4724-8e4e-764ad1434e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.555321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 947/1894] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:09.555501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099950f6-c074-4724-8e4e-764ad1434e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.555745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099950f6-c074-4724-8e4e-764ad1434e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.556120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099950f6-c074-4724-8e4e-764ad1434e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.556753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099950f6-c074-4724-8e4e-764ad1434e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.559157 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099950f6-c074-4724-8e4e-764ad1434e47 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.559389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e415db8-358e-49df-bcc7-319fb4bd5ec7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.570669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e415db8-358e-49df-bcc7-319fb4bd5ec7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.577914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7937a-0dd1-4747-b33c-9f47f926a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.578796 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7937a-0dd1-4747-b33c-9f47f926a3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.579121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7937a-0dd1-4747-b33c-9f47f926a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.579502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7937a-0dd1-4747-b33c-9f47f926a3c8 admin admin] PATH_INFO: `/v3/projects/811b56df5faa40dc9802f483c3e77e73/users/ce4bbea5eeb14814a7adabad660c21e3/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.588452 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 948/1895] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:09 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:09.590347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099950f6-c074-4724-8e4e-764ad1434e47 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.599753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7937a-0dd1-4747-b33c-9f47f926a3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811b56df5faa40dc9802f483c3e77e73, user_id=ce4bbea5eeb14814a7adabad660c21e3, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.602430 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7937a-0dd1-4747-b33c-9f47f926a3c8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.603768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099950f6-c074-4724-8e4e-764ad1434e47 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.609065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b418d8a-1318-4375-aa2c-014e18008839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.609752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b418d8a-1318-4375-aa2c-014e18008839 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.610041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b418d8a-1318-4375-aa2c-014e18008839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.610367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b418d8a-1318-4375-aa2c-014e18008839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.611740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b418d8a-1318-4375-aa2c-014e18008839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.613660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b418d8a-1318-4375-aa2c-014e18008839 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.616861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 948/1896] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:09 2022] PUT /identity/v3/projects/811b56df5faa40dc9802f483c3e77e73/users/ce4bbea5eeb14814a7adabad660c21e3/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:09.620822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7937a-0dd1-4747-b33c-9f47f926a3c8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.628648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 949/1897] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:09.631209 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b418d8a-1318-4375-aa2c-014e18008839 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.643534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b418d8a-1318-4375-aa2c-014e18008839 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.705240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7937a-0dd1-4747-b33c-9f47f926a3c8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.708295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd503d40-60ed-4bc9-822c-156124c96619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.709023 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd503d40-60ed-4bc9-822c-156124c96619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.709353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd503d40-60ed-4bc9-822c-156124c96619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.709597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd503d40-60ed-4bc9-822c-156124c96619 admin admin] PATH_INFO: `/v3/projects/475cfc928fa742f6b64b2a86306663e9/users/07af8af575d446b88d0147b6afb6906a/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.709888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f27a1-44dc-4d13-b87b-bc1767a016e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.710487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f27a1-44dc-4d13-b87b-bc1767a016e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.710762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f27a1-44dc-4d13-b87b-bc1767a016e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.711029 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f27a1-44dc-4d13-b87b-bc1767a016e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.711657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f27a1-44dc-4d13-b87b-bc1767a016e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.713296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f27a1-44dc-4d13-b87b-bc1767a016e6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.724427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 949/1898] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:09.724616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:09.728569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f27a1-44dc-4d13-b87b-bc1767a016e6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.729972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd503d40-60ed-4bc9-822c-156124c96619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475cfc928fa742f6b64b2a86306663e9, user_id=07af8af575d446b88d0147b6afb6906a, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.732792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd503d40-60ed-4bc9-822c-156124c96619 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.739191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f27a1-44dc-4d13-b87b-bc1767a016e6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.744285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9555a4-5d2a-4875-9258-b22a604831d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.744929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9555a4-5d2a-4875-9258-b22a604831d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.745281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9555a4-5d2a-4875-9258-b22a604831d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.745540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9555a4-5d2a-4875-9258-b22a604831d9 admin admin] PATH_INFO: `/v3/projects/811b56df5faa40dc9802f483c3e77e73/users/ce4bbea5eeb14814a7adabad660c21e3/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.747447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9555a4-5d2a-4875-9258-b22a604831d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811b56df5faa40dc9802f483c3e77e73, user_id=ce4bbea5eeb14814a7adabad660c21e3, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.747952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 950/1899] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:09 2022] PUT /identity/v3/projects/475cfc928fa742f6b64b2a86306663e9/users/07af8af575d446b88d0147b6afb6906a/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:09.750189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9555a4-5d2a-4875-9258-b22a604831d9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.751868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd503d40-60ed-4bc9-822c-156124c96619 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.761101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 950/1900] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:09 2022] PUT /identity/v3/projects/811b56df5faa40dc9802f483c3e77e73/users/ce4bbea5eeb14814a7adabad660c21e3/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:09.771757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5647b-f5f0-4f58-aa66-fbd23928831e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.772036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5647b-f5f0-4f58-aa66-fbd23928831e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.772310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5647b-f5f0-4f58-aa66-fbd23928831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.802697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3ed5647b-f5f0-4f58-aa66-fbd23928831e None None] MFA Rules not processed for user `ce4bbea5eeb14814a7adabad660c21e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:09.804200 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3ed5647b-f5f0-4f58-aa66-fbd23928831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:09.819904 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd503d40-60ed-4bc9-822c-156124c96619 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.881740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 951/1901] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:09.882485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03707-c19a-4602-826b-22ee2d1045fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.883097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03707-c19a-4602-826b-22ee2d1045fe admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.883371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03707-c19a-4602-826b-22ee2d1045fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.883636 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03707-c19a-4602-826b-22ee2d1045fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.884270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c03707-c19a-4602-826b-22ee2d1045fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.886067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c03707-c19a-4602-826b-22ee2d1045fe admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.896159 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5647b-f5f0-4f58-aa66-fbd23928831e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.900451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 951/1902] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:09.900628 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3ed5647b-f5f0-4f58-aa66-fbd23928831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:09.901585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03707-c19a-4602-826b-22ee2d1045fe admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:09.913313 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03707-c19a-4602-826b-22ee2d1045fe admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.918595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7241ea-53a0-44df-8283-fd91f4cd5582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:09.918990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7241ea-53a0-44df-8283-fd91f4cd5582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.919328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7241ea-53a0-44df-8283-fd91f4cd5582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.919662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7241ea-53a0-44df-8283-fd91f4cd5582 admin admin] PATH_INFO: `/v3/projects/475cfc928fa742f6b64b2a86306663e9/users/07af8af575d446b88d0147b6afb6906a/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.921606 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7241ea-53a0-44df-8283-fd91f4cd5582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475cfc928fa742f6b64b2a86306663e9, user_id=07af8af575d446b88d0147b6afb6906a, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:09.924854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7241ea-53a0-44df-8283-fd91f4cd5582 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:09.935737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 952/1903] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:09 2022] PUT /identity/v3/projects/475cfc928fa742f6b64b2a86306663e9/users/07af8af575d446b88d0147b6afb6906a/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:09.937907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:09.947078 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5504251-47bc-4cde-9dc8-61bbea519815 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:09.947366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5504251-47bc-4cde-9dc8-61bbea519815 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:09.947637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5504251-47bc-4cde-9dc8-61bbea519815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:09.961924 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5647b-f5f0-4f58-aa66-fbd23928831e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:09.977160 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d5504251-47bc-4cde-9dc8-61bbea519815 None None] MFA Rules not processed for user `07af8af575d446b88d0147b6afb6906a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:09.978282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d5504251-47bc-4cde-9dc8-61bbea519815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:10.011423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c774-47d0-478b-8f35-49f7cdeeea5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:10.012207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c774-47d0-478b-8f35-49f7cdeeea5f service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:10.012542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c774-47d0-478b-8f35-49f7cdeeea5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:10.012815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c774-47d0-478b-8f35-49f7cdeeea5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:10.046467 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 953/1904] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:10.057159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5504251-47bc-4cde-9dc8-61bbea519815 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:10.062684 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:10.067160 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5504251-47bc-4cde-9dc8-61bbea519815 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:10.072103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d74a0-1178-4e04-8e9a-0709934cce3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:10.072705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d74a0-1178-4e04-8e9a-0709934cce3b service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:10.073002 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d74a0-1178-4e04-8e9a-0709934cce3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:10.073284 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d74a0-1178-4e04-8e9a-0709934cce3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:10.078185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10c774-47d0-478b-8f35-49f7cdeeea5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:10.079668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10c774-47d0-478b-8f35-49f7cdeeea5f service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:10.089870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 952/1905] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:28:10.132715 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d74a0-1178-4e04-8e9a-0709934cce3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:10.134350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d74a0-1178-4e04-8e9a-0709934cce3b service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:10.144593 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 954/1906] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:28:10.176400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c774-47d0-478b-8f35-49f7cdeeea5f service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:10.187090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c774-47d0-478b-8f35-49f7cdeeea5f service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:10.191131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50843c59-f06c-4184-ae5a-ab46e366e3b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:10.191831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50843c59-f06c-4184-ae5a-ab46e366e3b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:10.192165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50843c59-f06c-4184-ae5a-ab46e366e3b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:10.192539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50843c59-f06c-4184-ae5a-ab46e366e3b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:10.254407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50843c59-f06c-4184-ae5a-ab46e366e3b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:10.255813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50843c59-f06c-4184-ae5a-ab46e366e3b5 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:10.266397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 953/1907] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:10.537569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb637-c5b2-489a-8db9-add4bb362ee7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:10.538031 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb637-c5b2-489a-8db9-add4bb362ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:10.538316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb637-c5b2-489a-8db9-add4bb362ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:10.558109 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a1dbb637-c5b2-489a-8db9-add4bb362ee7 None None] MFA Rules not processed for user `977979e33b244cf8aceff6eddc8653b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:10.559331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a1dbb637-c5b2-489a-8db9-add4bb362ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:10.647372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 955/1908] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:13.266092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50843c59-f06c-4184-ae5a-ab46e366e3b5 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:13.268993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-50843c59-f06c-4184-ae5a-ab46e366e3b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:13.329225 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:13.363413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50843c59-f06c-4184-ae5a-ab46e366e3b5 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:13.375576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:13.376241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:13.377061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:13.377442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] PATH_INFO: `/v3/users/23f4b815a3204fccbf41d825ccf9f9a8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:13.382076 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f4b815a3204fccbf41d825ccf9f9a8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:13.384072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:13.451695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f4b815a3204fccbf41d825ccf9f9a8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:13.467523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f4b815a3204fccbf41d825ccf9f9a8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:13.468601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f4b815a3204fccbf41d825ccf9f9a8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:13.497428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f4b815a3204fccbf41d825ccf9f9a8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:13.518004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f4b815a3204fccbf41d825ccf9f9a8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:13.553101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 954/1909] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:13 2022] DELETE /identity/v3/users/23f4b815a3204fccbf41d825ccf9f9a8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:13.555689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e0a8c-949f-457b-9061-b206d9f89ed6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:13.556673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e0a8c-949f-457b-9061-b206d9f89ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:13.557207 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e0a8c-949f-457b-9061-b206d9f89ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:13.633221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ad8e0a8c-949f-457b-9061-b206d9f89ed6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:13.634555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ad8e0a8c-949f-457b-9061-b206d9f89ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:13.751492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 956/1910] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:13.762568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:13.772734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:13.856898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937e194-e04e-4ca2-aadd-0f348753d2a3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:13.865359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b03d1-e2fb-4f3c-b6db-c32c5475f727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:13.866528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b03d1-e2fb-4f3c-b6db-c32c5475f727 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:13.866952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b03d1-e2fb-4f3c-b6db-c32c5475f727 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:13.867453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b03d1-e2fb-4f3c-b6db-c32c5475f727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:13.880807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b03d1-e2fb-4f3c-b6db-c32c5475f727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:13.882654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b03d1-e2fb-4f3c-b6db-c32c5475f727 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:13.896310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 955/1911] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:14.769462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e0a8c-949f-457b-9061-b206d9f89ed6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:14.771231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ad8e0a8c-949f-457b-9061-b206d9f89ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:14.792025 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b03d1-e2fb-4f3c-b6db-c32c5475f727 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:14.793687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-aa4b03d1-e2fb-4f3c-b6db-c32c5475f727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:14.827440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b03d1-e2fb-4f3c-b6db-c32c5475f727 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:14.834954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:14.836355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:14.836634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:14.836903 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] PATH_INFO: `/v3/projects/88b36a022c0349a9abfcdb8d338e6119` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:14.838270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b36a022c0349a9abfcdb8d338e6119)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:14.841485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:14.882440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:14.889213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e0a8c-949f-457b-9061-b206d9f89ed6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:14.894841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f27dc8-d332-4759-b414-3c015986020c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:14.896187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f27dc8-d332-4759-b414-3c015986020c service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:14.896460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f27dc8-d332-4759-b414-3c015986020c service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:14.896885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f27dc8-d332-4759-b414-3c015986020c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:14.901301 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-90f27dc8-d332-4759-b414-3c015986020c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:14.921322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b36a022c0349a9abfcdb8d338e6119', 'request_id': 'req-7ea29823-0439-43b0-be2e-259d4b27d30e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:14.926671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:14.931762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b36a022c0349a9abfcdb8d338e6119', 'request_id': 'req-7ea29823-0439-43b0-be2e-259d4b27d30e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:14.948405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b36a022c0349a9abfcdb8d338e6119', 'request_id': 'req-7ea29823-0439-43b0-be2e-259d4b27d30e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:14.962300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] The token cache is being invalidate because project 88b36a022c0349a9abfcdb8d338e6119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:14.962616 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:14.963268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:14.977040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 956/1912] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:14 2022] DELETE /identity/v3/projects/88b36a022c0349a9abfcdb8d338e6119 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:15.004145 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f27dc8-d332-4759-b414-3c015986020c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:15.005804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f27dc8-d332-4759-b414-3c015986020c service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:15.021379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 957/1913] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:15.699551 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:15.700996 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:15.791814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea29823-0439-43b0-be2e-259d4b27d30e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:15.798455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:15.799797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:15.800981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:15.801497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] PATH_INFO: `/v3/users/bcc509e3dcc6402e993651a143d1011c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:15.803033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc509e3dcc6402e993651a143d1011c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:15.805273 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:15.869453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc509e3dcc6402e993651a143d1011c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:15.876580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc509e3dcc6402e993651a143d1011c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:15.877257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc509e3dcc6402e993651a143d1011c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:15.889913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc509e3dcc6402e993651a143d1011c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:15.896731 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc509e3dcc6402e993651a143d1011c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:15.902521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 957/1914] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:15 2022] DELETE /identity/v3/users/bcc509e3dcc6402e993651a143d1011c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:15.907394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee75f72-8fed-4e62-ac6a-172b765c0c19 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:15.908518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee75f72-8fed-4e62-ac6a-172b765c0c19 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:15.908645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee75f72-8fed-4e62-ac6a-172b765c0c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:15.930544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-bee75f72-8fed-4e62-ac6a-172b765c0c19 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:15.931695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bee75f72-8fed-4e62-ac6a-172b765c0c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:15.990845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 958/1915] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:16.000391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:16.001958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:16.060186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7e328-7c88-417b-a565-e440d48ca2c0 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:16.063873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a2215-58d5-4541-8406-a7f203990177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:16.064700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a2215-58d5-4541-8406-a7f203990177 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:16.064979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a2215-58d5-4541-8406-a7f203990177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:16.065281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a2215-58d5-4541-8406-a7f203990177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:16.074758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a2215-58d5-4541-8406-a7f203990177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:16.076253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a2215-58d5-4541-8406-a7f203990177 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:16.087123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 958/1916] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:16.361877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee75f72-8fed-4e62-ac6a-172b765c0c19 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:16.363312 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bee75f72-8fed-4e62-ac6a-172b765c0c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:16.378045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee75f72-8fed-4e62-ac6a-172b765c0c19 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:16.382674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:16.383302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:16.383575 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:16.383842 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] PATH_INFO: `/v3/projects/1e283e21b3b54897a9df3f65062b43ff` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:16.384943 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e283e21b3b54897a9df3f65062b43ff)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:16.386859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:16.434139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e283e21b3b54897a9df3f65062b43ff', 'request_id': 'req-51a51e8a-6ab8-4980-8d48-995b1b6efe50'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:16.439933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e283e21b3b54897a9df3f65062b43ff', 'request_id': 'req-51a51e8a-6ab8-4980-8d48-995b1b6efe50'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:16.445848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e283e21b3b54897a9df3f65062b43ff', 'request_id': 'req-51a51e8a-6ab8-4980-8d48-995b1b6efe50'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:16.458579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] The token cache is being invalidate because project 1e283e21b3b54897a9df3f65062b43ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:16.458861 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:16.459491 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:16.460941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 959/1917] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:16 2022] DELETE /identity/v3/projects/1e283e21b3b54897a9df3f65062b43ff => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:16.464787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a2215-58d5-4541-8406-a7f203990177 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:16.471019 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:16.475162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a2215-58d5-4541-8406-a7f203990177 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:16.540125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:16.540759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:16.541050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:16.541354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] PATH_INFO: `/v3/users/ce4bbea5eeb14814a7adabad660c21e3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:16.542480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4bbea5eeb14814a7adabad660c21e3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:16.544403 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:16.593296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4bbea5eeb14814a7adabad660c21e3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:16.601861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4bbea5eeb14814a7adabad660c21e3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:16.602562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4bbea5eeb14814a7adabad660c21e3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:16.620783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4bbea5eeb14814a7adabad660c21e3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:16.629523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-eb3efa2f-ce0c-480d-ade2-e1279a3a975e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4bbea5eeb14814a7adabad660c21e3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:16.636059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 959/1918] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:16 2022] DELETE /identity/v3/users/ce4bbea5eeb14814a7adabad660c21e3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:17.149264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:17.150801 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:17.166631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a51e8a-6ab8-4980-8d48-995b1b6efe50 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:17.190827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:17.243347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:17.243991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.244280 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.244546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] PATH_INFO: `/v3/projects/811b56df5faa40dc9802f483c3e77e73` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.245748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=811b56df5faa40dc9802f483c3e77e73)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:17.247760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:17.309999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811b56df5faa40dc9802f483c3e77e73', 'request_id': 'req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:17.316986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811b56df5faa40dc9802f483c3e77e73', 'request_id': 'req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:17.324260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811b56df5faa40dc9802f483c3e77e73', 'request_id': 'req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:17.341330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] The token cache is being invalidate because project 811b56df5faa40dc9802f483c3e77e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:17.341624 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:17.342272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87c0b90b-3dbe-48fc-98e4-e666ad47b9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:17.343845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 960/1919] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:17 2022] DELETE /identity/v3/projects/811b56df5faa40dc9802f483c3e77e73 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:17.349848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07fcb8-968f-45d1-8fa7-e4090e1bc058 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.350335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07fcb8-968f-45d1-8fa7-e4090e1bc058 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.350597 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07fcb8-968f-45d1-8fa7-e4090e1bc058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.370788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ca07fcb8-968f-45d1-8fa7-e4090e1bc058 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:17.371987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ca07fcb8-968f-45d1-8fa7-e4090e1bc058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:17.432629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 960/1920] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:17.440718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368cfb8-9d84-4545-b8b7-26a9d18a0d86 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.441079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368cfb8-9d84-4545-b8b7-26a9d18a0d86 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.441303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368cfb8-9d84-4545-b8b7-26a9d18a0d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.462001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3368cfb8-9d84-4545-b8b7-26a9d18a0d86 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:17.463186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3368cfb8-9d84-4545-b8b7-26a9d18a0d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:17.472584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 961/1921] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:17.477491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07fcb8-968f-45d1-8fa7-e4090e1bc058 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:17.487765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07fcb8-968f-45d1-8fa7-e4090e1bc058 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:17.492497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e15f1-e215-4ad5-b2e8-4daeb6e52ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:17.493144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e15f1-e215-4ad5-b2e8-4daeb6e52ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.493442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e15f1-e215-4ad5-b2e8-4daeb6e52ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.493696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e15f1-e215-4ad5-b2e8-4daeb6e52ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.494371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e15f1-e215-4ad5-b2e8-4daeb6e52ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:17.494672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e15f1-e215-4ad5-b2e8-4daeb6e52ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:17.496267 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e15f1-e215-4ad5-b2e8-4daeb6e52ac4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:17.508495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 961/1922] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:17.513345 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368cfb8-9d84-4545-b8b7-26a9d18a0d86 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:17.524590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368cfb8-9d84-4545-b8b7-26a9d18a0d86 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:17.529249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957acff7-2b68-4e16-9347-f140a282667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:17.529838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acff7-2b68-4e16-9347-f140a282667c admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.530109 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acff7-2b68-4e16-9347-f140a282667c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.530372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acff7-2b68-4e16-9347-f140a282667c admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.530987 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957acff7-2b68-4e16-9347-f140a282667c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:17.533431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957acff7-2b68-4e16-9347-f140a282667c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:17.560213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 962/1923] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:17 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:17.564419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e15f1-e215-4ad5-b2e8-4daeb6e52ac4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:17.574371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e15f1-e215-4ad5-b2e8-4daeb6e52ac4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:17.582580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:17.635369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f660-acae-4521-b278-98b987da2f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:17.635976 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f660-acae-4521-b278-98b987da2f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.636253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f660-acae-4521-b278-98b987da2f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.636529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8f660-acae-4521-b278-98b987da2f69 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.637204 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8f660-acae-4521-b278-98b987da2f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:17.639287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8f660-acae-4521-b278-98b987da2f69 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:17.661844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 962/1924] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:17 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:17.666140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957acff7-2b68-4e16-9347-f140a282667c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:17.676887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957acff7-2b68-4e16-9347-f140a282667c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:17.681478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f120c-6e28-442a-a99c-0daf4741d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:17.682063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f120c-6e28-442a-a99c-0daf4741d0fb admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.682336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f120c-6e28-442a-a99c-0daf4741d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.682604 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f120c-6e28-442a-a99c-0daf4741d0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.683232 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f120c-6e28-442a-a99c-0daf4741d0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:17.684803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f120c-6e28-442a-a99c-0daf4741d0fb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:17.694623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 963/1925] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:17.698427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f660-acae-4521-b278-98b987da2f69 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:17.708625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8f660-acae-4521-b278-98b987da2f69 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:17.713215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6d143-5a51-43f1-8b16-9a86ea15b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:17.713799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d143-5a51-43f1-8b16-9a86ea15b110 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.714073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d143-5a51-43f1-8b16-9a86ea15b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.714341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d143-5a51-43f1-8b16-9a86ea15b110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.714969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6d143-5a51-43f1-8b16-9a86ea15b110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:17.717111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6d143-5a51-43f1-8b16-9a86ea15b110 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:17.728822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 963/1926] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:17.732783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f120c-6e28-442a-a99c-0daf4741d0fb admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:17.742878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f120c-6e28-442a-a99c-0daf4741d0fb admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:17.747527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0184ee-48c5-47d4-8653-a73aa648d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:17.748160 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0184ee-48c5-47d4-8653-a73aa648d32b admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.748442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0184ee-48c5-47d4-8653-a73aa648d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.748719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0184ee-48c5-47d4-8653-a73aa648d32b admin admin] PATH_INFO: `/v3/projects/63986c19818241cb944b19eafceadad1/users/3ab85fa74af248788d873765ae3c899e/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.763096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0184ee-48c5-47d4-8653-a73aa648d32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63986c19818241cb944b19eafceadad1, user_id=3ab85fa74af248788d873765ae3c899e, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:17.765775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0184ee-48c5-47d4-8653-a73aa648d32b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:17.779240 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 964/1927] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:17 2022] PUT /identity/v3/projects/63986c19818241cb944b19eafceadad1/users/3ab85fa74af248788d873765ae3c899e/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:17.791334 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3efa7a-52ed-46d6-8706-6d8e1bbb06ff None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:17.791615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3efa7a-52ed-46d6-8706-6d8e1bbb06ff None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:17.791887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3efa7a-52ed-46d6-8706-6d8e1bbb06ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:17.820044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6b3efa7a-52ed-46d6-8706-6d8e1bbb06ff None None] MFA Rules not processed for user `3ab85fa74af248788d873765ae3c899e`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:17.821285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6b3efa7a-52ed-46d6-8706-6d8e1bbb06ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:17.892448 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 964/1928] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:17.907014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0184ee-48c5-47d4-8653-a73aa648d32b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:17.915729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0f0184ee-48c5-47d4-8653-a73aa648d32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:17.991924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:17.995638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0184ee-48c5-47d4-8653-a73aa648d32b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:17.999786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9e1db-4778-4d7d-9e4c-f4d679a8ddee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:18.000596 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9e1db-4778-4d7d-9e4c-f4d679a8ddee service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:18.000921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9e1db-4778-4d7d-9e4c-f4d679a8ddee service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:18.001668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9e1db-4778-4d7d-9e4c-f4d679a8ddee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:18.013478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9e1db-4778-4d7d-9e4c-f4d679a8ddee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:18.015434 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9e1db-4778-4d7d-9e4c-f4d679a8ddee service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:18.025756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 965/1929] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:20.140885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3efa7a-52ed-46d6-8706-6d8e1bbb06ff None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:20.142946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6b3efa7a-52ed-46d6-8706-6d8e1bbb06ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:20.212279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3efa7a-52ed-46d6-8706-6d8e1bbb06ff None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:20.217410 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:20.217984 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:20.218259 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:20.218536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] PATH_INFO: `/v3/users/44ce7f02d9e749e5a0f47bff1fcc1886` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:20.220486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ce7f02d9e749e5a0f47bff1fcc1886)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:20.223203 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:20.255178 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:20.289642 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ce7f02d9e749e5a0f47bff1fcc1886'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:20.297658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ce7f02d9e749e5a0f47bff1fcc1886'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:20.298684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ce7f02d9e749e5a0f47bff1fcc1886'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:20.311038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ce7f02d9e749e5a0f47bff1fcc1886'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:20.319352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ce7f02d9e749e5a0f47bff1fcc1886'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:20.326453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 965/1930] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:20 2022] DELETE /identity/v3/users/44ce7f02d9e749e5a0f47bff1fcc1886 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:20.331778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced047-b337-433d-93b4-e6893a8ff9f8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:20.332239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced047-b337-433d-93b4-e6893a8ff9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:20.332360 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced047-b337-433d-93b4-e6893a8ff9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:20.352398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e8ced047-b337-433d-93b4-e6893a8ff9f8 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:20.353691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e8ced047-b337-433d-93b4-e6893a8ff9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:20.417719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 966/1931] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:20.428246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:20.429685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:20.486521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f97c6-31fd-4212-9d69-055c32e28270 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:20.490581 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49758f-d669-4806-9f30-dcbaa56d1e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:20.491195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49758f-d669-4806-9f30-dcbaa56d1e3c service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:20.491465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49758f-d669-4806-9f30-dcbaa56d1e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:20.491754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49758f-d669-4806-9f30-dcbaa56d1e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:20.501209 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49758f-d669-4806-9f30-dcbaa56d1e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:20.503286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49758f-d669-4806-9f30-dcbaa56d1e3c service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:20.512515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 966/1932] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:28:20.786688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ced047-b337-433d-93b4-e6893a8ff9f8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:20.788597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e8ced047-b337-433d-93b4-e6893a8ff9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:20.812628 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ced047-b337-433d-93b4-e6893a8ff9f8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:20.819574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:20.820216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:20.820497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:20.820770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] PATH_INFO: `/v3/projects/e7bf35a9a4824b058a711aeaf1a94259` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:20.822286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7bf35a9a4824b058a711aeaf1a94259)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:20.824369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:20.888361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7bf35a9a4824b058a711aeaf1a94259', 'request_id': 'req-5313c4b8-3d16-4733-b4d7-afe300babe49'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:20.898246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7bf35a9a4824b058a711aeaf1a94259', 'request_id': 'req-5313c4b8-3d16-4733-b4d7-afe300babe49'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:20.911716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7bf35a9a4824b058a711aeaf1a94259', 'request_id': 'req-5313c4b8-3d16-4733-b4d7-afe300babe49'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:20.933037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] The token cache is being invalidate because project e7bf35a9a4824b058a711aeaf1a94259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:20.933380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:20.934014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:20.936335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 967/1933] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:20 2022] DELETE /identity/v3/projects/e7bf35a9a4824b058a711aeaf1a94259 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:20.940340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49758f-d669-4806-9f30-dcbaa56d1e3c service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:20.949843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49758f-d669-4806-9f30-dcbaa56d1e3c service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:21.023007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:21.024404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:21.024680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:21.024946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] PATH_INFO: `/v3/users/07af8af575d446b88d0147b6afb6906a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:21.026402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07af8af575d446b88d0147b6afb6906a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:21.028361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:21.082613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:21.085675 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07af8af575d446b88d0147b6afb6906a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:21.097264 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07af8af575d446b88d0147b6afb6906a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:21.098512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07af8af575d446b88d0147b6afb6906a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:21.116604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07af8af575d446b88d0147b6afb6906a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:21.123654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-85e24e86-4df7-4076-9ed7-c2fa35556807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07af8af575d446b88d0147b6afb6906a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:21.130363 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 967/1934] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:20 2022] DELETE /identity/v3/users/07af8af575d446b88d0147b6afb6906a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:21.444913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:21.447030 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:21.472929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313c4b8-3d16-4733-b4d7-afe300babe49 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:21.579090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:21.580580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:21.581065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:21.581613 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] PATH_INFO: `/v3/projects/475cfc928fa742f6b64b2a86306663e9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:21.582881 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=475cfc928fa742f6b64b2a86306663e9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:21.585112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:21.613430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:21.692279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475cfc928fa742f6b64b2a86306663e9', 'request_id': 'req-c855571f-975b-47bf-8553-78aa94e0d20f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:21.700581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475cfc928fa742f6b64b2a86306663e9', 'request_id': 'req-c855571f-975b-47bf-8553-78aa94e0d20f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:21.707865 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475cfc928fa742f6b64b2a86306663e9', 'request_id': 'req-c855571f-975b-47bf-8553-78aa94e0d20f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:21.725216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] The token cache is being invalidate because project 475cfc928fa742f6b64b2a86306663e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:21.725509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:21.726172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c855571f-975b-47bf-8553-78aa94e0d20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:21.727803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 968/1935] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:21 2022] DELETE /identity/v3/projects/475cfc928fa742f6b64b2a86306663e9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:21.733884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615489-9cf1-4c1b-a279-485da64dc5ba None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:21.734335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615489-9cf1-4c1b-a279-485da64dc5ba None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:21.734423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615489-9cf1-4c1b-a279-485da64dc5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:21.755448 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-68615489-9cf1-4c1b-a279-485da64dc5ba None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:21.756850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-68615489-9cf1-4c1b-a279-485da64dc5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:21.824159 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 968/1936] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:21.834086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff383d2b-4e28-483b-a164-cd4ea49fa6f6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:21.834480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff383d2b-4e28-483b-a164-cd4ea49fa6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:21.834852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff383d2b-4e28-483b-a164-cd4ea49fa6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:21.855408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ff383d2b-4e28-483b-a164-cd4ea49fa6f6 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:21.856717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ff383d2b-4e28-483b-a164-cd4ea49fa6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:21.865543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 969/1937] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:21.869788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68615489-9cf1-4c1b-a279-485da64dc5ba None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:21.881635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68615489-9cf1-4c1b-a279-485da64dc5ba None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:21.887872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d9dbc-db74-4b89-be57-00dfe1abb1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:21.888498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d9dbc-db74-4b89-be57-00dfe1abb1cb admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:21.888777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d9dbc-db74-4b89-be57-00dfe1abb1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:21.889076 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d9dbc-db74-4b89-be57-00dfe1abb1cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:21.889736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d9dbc-db74-4b89-be57-00dfe1abb1cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:21.890039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d9dbc-db74-4b89-be57-00dfe1abb1cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:21.891660 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d9dbc-db74-4b89-be57-00dfe1abb1cb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:21.921044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 969/1938] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:21.922916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff383d2b-4e28-483b-a164-cd4ea49fa6f6 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:21.934182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff383d2b-4e28-483b-a164-cd4ea49fa6f6 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:21.939607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d08155-5cd1-4c37-be89-e6a2be1f09cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:21.940137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d08155-5cd1-4c37-be89-e6a2be1f09cb admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:21.940410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d08155-5cd1-4c37-be89-e6a2be1f09cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:21.940675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d08155-5cd1-4c37-be89-e6a2be1f09cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:21.941329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d08155-5cd1-4c37-be89-e6a2be1f09cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:21.943216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d08155-5cd1-4c37-be89-e6a2be1f09cb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:21.972898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 970/1939] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:21 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:21.976962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d9dbc-db74-4b89-be57-00dfe1abb1cb admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:21.987456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d9dbc-db74-4b89-be57-00dfe1abb1cb admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.043591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e70a6-0d60-498d-aec6-131eecfdd7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.044188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e70a6-0d60-498d-aec6-131eecfdd7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.044463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e70a6-0d60-498d-aec6-131eecfdd7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.044732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e70a6-0d60-498d-aec6-131eecfdd7b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.045423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e70a6-0d60-498d-aec6-131eecfdd7b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:22.047393 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e70a6-0d60-498d-aec6-131eecfdd7b6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:22.075695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 970/1940] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:21 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:22.076975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d08155-5cd1-4c37-be89-e6a2be1f09cb admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.087412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d08155-5cd1-4c37-be89-e6a2be1f09cb admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.092117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecff9e0-71db-4ee4-935c-3d0f0594215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.092736 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecff9e0-71db-4ee4-935c-3d0f0594215f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.093035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecff9e0-71db-4ee4-935c-3d0f0594215f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.093312 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecff9e0-71db-4ee4-935c-3d0f0594215f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.093971 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecff9e0-71db-4ee4-935c-3d0f0594215f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:22.095552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecff9e0-71db-4ee4-935c-3d0f0594215f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:22.110093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 971/1941] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:22.114485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e70a6-0d60-498d-aec6-131eecfdd7b6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.127151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e70a6-0d60-498d-aec6-131eecfdd7b6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.132090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957b7d6-363b-472d-8ed4-25ca44cd216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.132695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957b7d6-363b-472d-8ed4-25ca44cd216a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.132988 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957b7d6-363b-472d-8ed4-25ca44cd216a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.133289 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957b7d6-363b-472d-8ed4-25ca44cd216a admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.133924 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957b7d6-363b-472d-8ed4-25ca44cd216a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:22.135529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957b7d6-363b-472d-8ed4-25ca44cd216a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:22.148733 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 971/1942] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:22.152566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecff9e0-71db-4ee4-935c-3d0f0594215f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.162669 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecff9e0-71db-4ee4-935c-3d0f0594215f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.167364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44b18a-8cac-4f4b-b84c-b26cb4140d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.168014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44b18a-8cac-4f4b-b84c-b26cb4140d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.168290 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44b18a-8cac-4f4b-b84c-b26cb4140d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.168566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44b18a-8cac-4f4b-b84c-b26cb4140d1a admin admin] PATH_INFO: `/v3/projects/96bd293a30b34629a1b01d46c32160d7/users/b0be683da08b4f379da60d4dd4a048ec/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.184220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44b18a-8cac-4f4b-b84c-b26cb4140d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bd293a30b34629a1b01d46c32160d7, user_id=b0be683da08b4f379da60d4dd4a048ec, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:22.186871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44b18a-8cac-4f4b-b84c-b26cb4140d1a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:22.202728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 972/1943] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:22 2022] PUT /identity/v3/projects/96bd293a30b34629a1b01d46c32160d7/users/b0be683da08b4f379da60d4dd4a048ec/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:22.207698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a20f0-fd28-438e-804d-aae2166971a8 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.207979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a20f0-fd28-438e-804d-aae2166971a8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.208249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a20f0-fd28-438e-804d-aae2166971a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.227599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cb8a20f0-fd28-438e-804d-aae2166971a8 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:22.228776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cb8a20f0-fd28-438e-804d-aae2166971a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:22.248635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:22.291315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 972/1944] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:22.301033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44b18a-8cac-4f4b-b84c-b26cb4140d1a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:22.302829 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ea44b18a-8cac-4f4b-b84c-b26cb4140d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:22.362474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44b18a-8cac-4f4b-b84c-b26cb4140d1a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:22.366320 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08c303-1112-4ba1-a74a-08a485cb7b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:22.366946 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c303-1112-4ba1-a74a-08a485cb7b0b service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:22.367220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c303-1112-4ba1-a74a-08a485cb7b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:22.367489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08c303-1112-4ba1-a74a-08a485cb7b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:22.378507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08c303-1112-4ba1-a74a-08a485cb7b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:22.380003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08c303-1112-4ba1-a74a-08a485cb7b0b service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:22.389589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 973/1945] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:23.137655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515e8dd-ee93-4966-bd59-e05eea1ded31 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:23.138123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515e8dd-ee93-4966-bd59-e05eea1ded31 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:23.138203 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515e8dd-ee93-4966-bd59-e05eea1ded31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:23.173499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9515e8dd-ee93-4966-bd59-e05eea1ded31 None None] MFA Rules not processed for user `b0be683da08b4f379da60d4dd4a048ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:23.174904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9515e8dd-ee93-4966-bd59-e05eea1ded31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:23.273694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 973/1946] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:23.286089 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08c303-1112-4ba1-a74a-08a485cb7b0b service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:23.287648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7b08c303-1112-4ba1-a74a-08a485cb7b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:23.345562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:23.367698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08c303-1112-4ba1-a74a-08a485cb7b0b service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:23.372174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2bcfe-c863-4178-a9ba-183a56374dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:23.372788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2bcfe-c863-4178-a9ba-183a56374dcb service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:23.373091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2bcfe-c863-4178-a9ba-183a56374dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:23.373367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2bcfe-c863-4178-a9ba-183a56374dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:23.384534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2bcfe-c863-4178-a9ba-183a56374dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:23.386014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2bcfe-c863-4178-a9ba-183a56374dcb service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:23.396303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 974/1947] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:24.881985 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa71513-b933-407f-851c-e2000a6b0751 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:24.882562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa71513-b933-407f-851c-e2000a6b0751 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:24.882562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa71513-b933-407f-851c-e2000a6b0751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:24.907016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-dfa71513-b933-407f-851c-e2000a6b0751 None None] MFA Rules not processed for user `b0be683da08b4f379da60d4dd4a048ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:24.908700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dfa71513-b933-407f-851c-e2000a6b0751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:24.921693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 974/1948] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:28.593134 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2bcfe-c863-4178-a9ba-183a56374dcb service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:28.594695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-73c2bcfe-c863-4178-a9ba-183a56374dcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:28.608884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2bcfe-c863-4178-a9ba-183a56374dcb service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:28.615652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:28.616305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:28.616582 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:28.616853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] PATH_INFO: `/v3/users/3ab85fa74af248788d873765ae3c899e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:28.618087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab85fa74af248788d873765ae3c899e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:28.620011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:28.671981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab85fa74af248788d873765ae3c899e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:28.672828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab85fa74af248788d873765ae3c899e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:28.681266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab85fa74af248788d873765ae3c899e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:28.681961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab85fa74af248788d873765ae3c899e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:28.694848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab85fa74af248788d873765ae3c899e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:28.714961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 975/1949] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:28 2022] DELETE /identity/v3/users/3ab85fa74af248788d873765ae3c899e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:28.719526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c03ce-2c6e-4913-a82b-e28124dc7117 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:28.720641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c03ce-2c6e-4913-a82b-e28124dc7117 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:28.720741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c03ce-2c6e-4913-a82b-e28124dc7117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:28.741697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-939c03ce-2c6e-4913-a82b-e28124dc7117 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:28.742936 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-939c03ce-2c6e-4913-a82b-e28124dc7117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:28.807124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 975/1950] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:28.818137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:28.819578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:28.884678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce9557-3984-40bb-bb6a-503077de3ccf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:28.889086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f462d1-c9e4-4d27-8eb6-f433b4a70b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:28.889703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f462d1-c9e4-4d27-8eb6-f433b4a70b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:28.889980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f462d1-c9e4-4d27-8eb6-f433b4a70b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:28.890251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f462d1-c9e4-4d27-8eb6-f433b4a70b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:28.900585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f462d1-c9e4-4d27-8eb6-f433b4a70b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:28.902184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f462d1-c9e4-4d27-8eb6-f433b4a70b94 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:28.919050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 976/1951] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:28:29.367190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c03ce-2c6e-4913-a82b-e28124dc7117 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:29.368611 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-939c03ce-2c6e-4913-a82b-e28124dc7117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:29.382167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c03ce-2c6e-4913-a82b-e28124dc7117 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:29.387022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:29.388033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:29.388574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:29.388846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] PATH_INFO: `/v3/projects/63986c19818241cb944b19eafceadad1` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:29.390025 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63986c19818241cb944b19eafceadad1)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:29.392619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:29.497439 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:29.502519 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63986c19818241cb944b19eafceadad1', 'request_id': 'req-f4ae964d-ecdf-442c-b0a0-98468d7b7879'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:29.540493 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63986c19818241cb944b19eafceadad1', 'request_id': 'req-f4ae964d-ecdf-442c-b0a0-98468d7b7879'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:29.549425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63986c19818241cb944b19eafceadad1', 'request_id': 'req-f4ae964d-ecdf-442c-b0a0-98468d7b7879'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:29.568185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] The token cache is being invalidate because project 63986c19818241cb944b19eafceadad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:29.568475 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:29.569246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-f4ae964d-ecdf-442c-b0a0-98468d7b7879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:29.571370 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 976/1952] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:29 2022] DELETE /identity/v3/projects/63986c19818241cb944b19eafceadad1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:29.576018 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a30fd-1d80-43b8-bfa0-fa9f7d7c16d7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:29.576296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a30fd-1d80-43b8-bfa0-fa9f7d7c16d7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:29.576569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a30fd-1d80-43b8-bfa0-fa9f7d7c16d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:29.606817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-699a30fd-1d80-43b8-bfa0-fa9f7d7c16d7 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:29.608582 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-699a30fd-1d80-43b8-bfa0-fa9f7d7c16d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:29.685264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 977/1953] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:29.693286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e192-68e9-49fc-94b0-ae329c789629 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:29.693569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e192-68e9-49fc-94b0-ae329c789629 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:29.693841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96e192-68e9-49fc-94b0-ae329c789629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:29.716833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7d96e192-68e9-49fc-94b0-ae329c789629 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:29.718087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7d96e192-68e9-49fc-94b0-ae329c789629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:29.729047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 977/1954] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:29.732701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a30fd-1d80-43b8-bfa0-fa9f7d7c16d7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:29.737941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:29.743871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a30fd-1d80-43b8-bfa0-fa9f7d7c16d7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:29.752695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29704ed9-7054-4716-bec8-52a0d70c156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:29.753364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29704ed9-7054-4716-bec8-52a0d70c156c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:29.753821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29704ed9-7054-4716-bec8-52a0d70c156c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:29.754522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29704ed9-7054-4716-bec8-52a0d70c156c admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:29.755310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29704ed9-7054-4716-bec8-52a0d70c156c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:29.755621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29704ed9-7054-4716-bec8-52a0d70c156c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:29.757261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29704ed9-7054-4716-bec8-52a0d70c156c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:29.773920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 978/1955] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:29.776054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96e192-68e9-49fc-94b0-ae329c789629 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:29.786449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96e192-68e9-49fc-94b0-ae329c789629 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:29.791299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab6f5c-a80a-4d4e-9b5f-38feb7d733dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:29.792048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab6f5c-a80a-4d4e-9b5f-38feb7d733dd admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:29.792535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab6f5c-a80a-4d4e-9b5f-38feb7d733dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:29.792994 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab6f5c-a80a-4d4e-9b5f-38feb7d733dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:29.793930 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab6f5c-a80a-4d4e-9b5f-38feb7d733dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:29.796082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab6f5c-a80a-4d4e-9b5f-38feb7d733dd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:29.859762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 978/1956] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:29 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:29.860597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29704ed9-7054-4716-bec8-52a0d70c156c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:29.874462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29704ed9-7054-4716-bec8-52a0d70c156c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:29.957546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c773a7c-3877-40ca-85d2-73dcc8e128d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:29.958190 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c773a7c-3877-40ca-85d2-73dcc8e128d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:29.958470 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c773a7c-3877-40ca-85d2-73dcc8e128d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:29.958741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c773a7c-3877-40ca-85d2-73dcc8e128d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:29.959386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c773a7c-3877-40ca-85d2-73dcc8e128d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:29.961898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c773a7c-3877-40ca-85d2-73dcc8e128d1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:29.987374 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 979/1957] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:29 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:29.995420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab6f5c-a80a-4d4e-9b5f-38feb7d733dd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:30.008179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab6f5c-a80a-4d4e-9b5f-38feb7d733dd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:30.013619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13843ddd-e440-4824-8f2c-14687428de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:30.014586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843ddd-e440-4824-8f2c-14687428de56 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:30.014586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843ddd-e440-4824-8f2c-14687428de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:30.014873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843ddd-e440-4824-8f2c-14687428de56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:30.015828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13843ddd-e440-4824-8f2c-14687428de56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:30.018664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13843ddd-e440-4824-8f2c-14687428de56 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:30.030085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 979/1958] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:30.035029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c773a7c-3877-40ca-85d2-73dcc8e128d1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:30.047412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c773a7c-3877-40ca-85d2-73dcc8e128d1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:30.052518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f7c0a-0479-487a-8c98-65dab1b0356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:30.053153 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7c0a-0479-487a-8c98-65dab1b0356f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:30.053576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7c0a-0479-487a-8c98-65dab1b0356f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:30.053780 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7c0a-0479-487a-8c98-65dab1b0356f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:30.054889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f7c0a-0479-487a-8c98-65dab1b0356f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:30.055992 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f7c0a-0479-487a-8c98-65dab1b0356f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:30.073055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 980/1959] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:30.073810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13843ddd-e440-4824-8f2c-14687428de56 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:30.086499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13843ddd-e440-4824-8f2c-14687428de56 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:30.092169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d42f69-67b3-482a-96b7-dd38b9f3ce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:30.092916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d42f69-67b3-482a-96b7-dd38b9f3ce72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:30.093315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d42f69-67b3-482a-96b7-dd38b9f3ce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:30.093686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d42f69-67b3-482a-96b7-dd38b9f3ce72 admin admin] PATH_INFO: `/v3/projects/64b2131e236b49e18d929e4e715184c0/users/c57a7fdac4554d39aba864be2c824e40/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:30.117721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d42f69-67b3-482a-96b7-dd38b9f3ce72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b2131e236b49e18d929e4e715184c0, user_id=c57a7fdac4554d39aba864be2c824e40, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:30.118515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d42f69-67b3-482a-96b7-dd38b9f3ce72 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:30.137135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 980/1960] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:30 2022] PUT /identity/v3/projects/64b2131e236b49e18d929e4e715184c0/users/c57a7fdac4554d39aba864be2c824e40/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:30.149699 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222432dd-b2dc-4462-bf0c-69590be79103 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:30.149995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222432dd-b2dc-4462-bf0c-69590be79103 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:30.150268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222432dd-b2dc-4462-bf0c-69590be79103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:30.189614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-222432dd-b2dc-4462-bf0c-69590be79103 None None] MFA Rules not processed for user `c57a7fdac4554d39aba864be2c824e40`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:30.190831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-222432dd-b2dc-4462-bf0c-69590be79103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:30.269622 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 981/1961] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:30.280545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d42f69-67b3-482a-96b7-dd38b9f3ce72 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:30.283239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-68d42f69-67b3-482a-96b7-dd38b9f3ce72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:30.346391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d42f69-67b3-482a-96b7-dd38b9f3ce72 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:30.351624 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff128b82-5750-4e05-b017-a352d00f3a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:30.352263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff128b82-5750-4e05-b017-a352d00f3a2e service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:30.352606 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff128b82-5750-4e05-b017-a352d00f3a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:30.352775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff128b82-5750-4e05-b017-a352d00f3a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:30.362670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff128b82-5750-4e05-b017-a352d00f3a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:30.364237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff128b82-5750-4e05-b017-a352d00f3a2e service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:30.374323 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 981/1962] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:31.797599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054fcd-ee4c-4e53-8643-b8b3f3193b36 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:31.798803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054fcd-ee4c-4e53-8643-b8b3f3193b36 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:31.798803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054fcd-ee4c-4e53-8643-b8b3f3193b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:31.819291 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-f7054fcd-ee4c-4e53-8643-b8b3f3193b36 None None] MFA Rules not processed for user `c57a7fdac4554d39aba864be2c824e40`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:31.820525 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f7054fcd-ee4c-4e53-8643-b8b3f3193b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:31.827723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 982/1963] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:40.369719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:41.812271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:42.537862 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007a72-8df4-4918-a7c7-c9a9e1c026b7 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:42.538255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007a72-8df4-4918-a7c7-c9a9e1c026b7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:42.538424 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007a72-8df4-4918-a7c7-c9a9e1c026b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:42.560568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-89007a72-8df4-4918-a7c7-c9a9e1c026b7 None None] MFA Rules not processed for user `78bec0414d064ed8901271fc4c57cfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:42.562199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-89007a72-8df4-4918-a7c7-c9a9e1c026b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:42.644844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 982/1964] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:46.418027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7054fcd-ee4c-4e53-8643-b8b3f3193b36 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:46.419520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f7054fcd-ee4c-4e53-8643-b8b3f3193b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:46.484599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7054fcd-ee4c-4e53-8643-b8b3f3193b36 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:46.489748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:46.490377 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:46.490648 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:46.490912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] PATH_INFO: `/v3/users/515e76e494354c068bb4df6540a9f07d` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:46.492033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=515e76e494354c068bb4df6540a9f07d)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:46.493981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:46.543124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515e76e494354c068bb4df6540a9f07d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:46.543697 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515e76e494354c068bb4df6540a9f07d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:46.551364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515e76e494354c068bb4df6540a9f07d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:46.552023 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515e76e494354c068bb4df6540a9f07d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:46.564322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515e76e494354c068bb4df6540a9f07d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:46.578636 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 983/1965] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:28:46 2022] DELETE /identity/v3/users/515e76e494354c068bb4df6540a9f07d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:46.583664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc30f1-18ab-4200-a1ef-17b54e79bb47 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:46.584177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc30f1-18ab-4200-a1ef-17b54e79bb47 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:46.584177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc30f1-18ab-4200-a1ef-17b54e79bb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:46.603552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-edcc30f1-18ab-4200-a1ef-17b54e79bb47 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:46.604750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-edcc30f1-18ab-4200-a1ef-17b54e79bb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:46.672112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 983/1966] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:46.682473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:46.683851 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:46.740380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f380412-3ecd-4a02-8c0b-7b76ac15d66d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:46.744073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e7a8c-f193-4197-8486-c048e1701047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:46.744702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e7a8c-f193-4197-8486-c048e1701047 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:46.744982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e7a8c-f193-4197-8486-c048e1701047 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:46.745322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e7a8c-f193-4197-8486-c048e1701047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:46.755480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e7a8c-f193-4197-8486-c048e1701047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:46.756995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e7a8c-f193-4197-8486-c048e1701047 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:46.773210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 984/1967] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:47.074714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc30f1-18ab-4200-a1ef-17b54e79bb47 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:47.076407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-edcc30f1-18ab-4200-a1ef-17b54e79bb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:47.091679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc30f1-18ab-4200-a1ef-17b54e79bb47 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:47.097868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:47.098621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.098991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.099372 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] PATH_INFO: `/v3/projects/cde49dd8ea4b41f281576aa4236515ee` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:47.100608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde49dd8ea4b41f281576aa4236515ee)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:47.102636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:47.159808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde49dd8ea4b41f281576aa4236515ee', 'request_id': 'req-8bbf796d-4bea-4699-be51-0c57f3c565ed'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:47.167421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde49dd8ea4b41f281576aa4236515ee', 'request_id': 'req-8bbf796d-4bea-4699-be51-0c57f3c565ed'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:47.174468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde49dd8ea4b41f281576aa4236515ee', 'request_id': 'req-8bbf796d-4bea-4699-be51-0c57f3c565ed'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:47.187035 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] The token cache is being invalidate because project cde49dd8ea4b41f281576aa4236515ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:28:47.187360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:47.188043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8bbf796d-4bea-4699-be51-0c57f3c565ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:28:47.189649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 984/1968] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:28:47 2022] DELETE /identity/v3/projects/cde49dd8ea4b41f281576aa4236515ee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:47.195649 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b45a78-5797-4609-9efc-5b6e8715f29e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.195912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b45a78-5797-4609-9efc-5b6e8715f29e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.196211 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b45a78-5797-4609-9efc-5b6e8715f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:47.217538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-51b45a78-5797-4609-9efc-5b6e8715f29e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:47.218736 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-51b45a78-5797-4609-9efc-5b6e8715f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:47.238635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:47.284906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 985/1969] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:47.292638 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1ea4-1c7e-4761-afa6-cc9c0d2f3e5f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.292921 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1ea4-1c7e-4761-afa6-cc9c0d2f3e5f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.293226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d1ea4-1c7e-4761-afa6-cc9c0d2f3e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:47.313389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f98d1ea4-1c7e-4761-afa6-cc9c0d2f3e5f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:47.314575 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f98d1ea4-1c7e-4761-afa6-cc9c0d2f3e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:47.322609 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 985/1970] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:47.326698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b45a78-5797-4609-9efc-5b6e8715f29e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:47.336586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b45a78-5797-4609-9efc-5b6e8715f29e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:47.342200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582cf6-bee2-45f9-9a0a-c6b1e62f3f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:47.342803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582cf6-bee2-45f9-9a0a-c6b1e62f3f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.343085 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582cf6-bee2-45f9-9a0a-c6b1e62f3f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.343357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582cf6-bee2-45f9-9a0a-c6b1e62f3f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:47.344001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582cf6-bee2-45f9-9a0a-c6b1e62f3f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:28:47.344299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582cf6-bee2-45f9-9a0a-c6b1e62f3f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:47.345916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582cf6-bee2-45f9-9a0a-c6b1e62f3f7f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:47.359695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 986/1971] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:28:47.366755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d1ea4-1c7e-4761-afa6-cc9c0d2f3e5f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:47.376036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d1ea4-1c7e-4761-afa6-cc9c0d2f3e5f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:47.382098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e927-73bf-4a7e-aba1-868f8a022bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:47.382700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e927-73bf-4a7e-aba1-868f8a022bbc admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.382977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e927-73bf-4a7e-aba1-868f8a022bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.383250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e927-73bf-4a7e-aba1-868f8a022bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:47.383880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87e927-73bf-4a7e-aba1-868f8a022bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:47.385820 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87e927-73bf-4a7e-aba1-868f8a022bbc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:47.408202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:47.415831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 986/1972] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:47 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:47.420096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582cf6-bee2-45f9-9a0a-c6b1e62f3f7f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:47.430005 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582cf6-bee2-45f9-9a0a-c6b1e62f3f7f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:47.491652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49223194-da09-4828-881d-40eaae8bb1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:47.492474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49223194-da09-4828-881d-40eaae8bb1fe admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.492845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49223194-da09-4828-881d-40eaae8bb1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.493445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49223194-da09-4828-881d-40eaae8bb1fe admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:47.494181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49223194-da09-4828-881d-40eaae8bb1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:47.496156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49223194-da09-4828-881d-40eaae8bb1fe admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:47.528381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 987/1973] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:47 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:28:47.529709 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e927-73bf-4a7e-aba1-868f8a022bbc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:47.540930 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e927-73bf-4a7e-aba1-868f8a022bbc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:47.546175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb12d6-749e-422d-98a8-a636388a1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:47.547090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb12d6-749e-422d-98a8-a636388a1ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.547373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb12d6-749e-422d-98a8-a636388a1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.547642 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb12d6-749e-422d-98a8-a636388a1ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:47.548287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb12d6-749e-422d-98a8-a636388a1ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:47.550096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb12d6-749e-422d-98a8-a636388a1ebb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:47.562717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 987/1974] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:47.567340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49223194-da09-4828-881d-40eaae8bb1fe admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:47.578615 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49223194-da09-4828-881d-40eaae8bb1fe admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:47.584287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f89130-c51b-438d-a30b-112d3f827434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:47.585063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f89130-c51b-438d-a30b-112d3f827434 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.585353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f89130-c51b-438d-a30b-112d3f827434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.585626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f89130-c51b-438d-a30b-112d3f827434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:47.586282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f89130-c51b-438d-a30b-112d3f827434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:47.588087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f89130-c51b-438d-a30b-112d3f827434 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:47.601576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 988/1975] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:28:47.605745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb12d6-749e-422d-98a8-a636388a1ebb admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:47.616962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb12d6-749e-422d-98a8-a636388a1ebb admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:47.622409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0834a-d9bf-46d1-801d-33a6702d5e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:47.623487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0834a-d9bf-46d1-801d-33a6702d5e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.623776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0834a-d9bf-46d1-801d-33a6702d5e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.624122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0834a-d9bf-46d1-801d-33a6702d5e0e admin admin] PATH_INFO: `/v3/projects/ac70f7a12b4748be9c89ed804eadd1f8/users/15dc4bbe837f49c2b854bf4306ea8cfd/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:47.656379 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0834a-d9bf-46d1-801d-33a6702d5e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac70f7a12b4748be9c89ed804eadd1f8, user_id=15dc4bbe837f49c2b854bf4306ea8cfd, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:47.661298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0834a-d9bf-46d1-801d-33a6702d5e0e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:47.695606 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 988/1976] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:47 2022] PUT /identity/v3/projects/ac70f7a12b4748be9c89ed804eadd1f8/users/15dc4bbe837f49c2b854bf4306ea8cfd/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:28:47.701990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a2511-cbe2-42ee-82c2-1a1332b70e10 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.702274 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a2511-cbe2-42ee-82c2-1a1332b70e10 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.702546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a2511-cbe2-42ee-82c2-1a1332b70e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:47.750356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-fa1a2511-cbe2-42ee-82c2-1a1332b70e10 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:47.752174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fa1a2511-cbe2-42ee-82c2-1a1332b70e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:47.866713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 989/1977] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:47.886177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0834a-d9bf-46d1-801d-33a6702d5e0e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:47.888024 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c7f0834a-d9bf-46d1-801d-33a6702d5e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:47.990090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0834a-d9bf-46d1-801d-33a6702d5e0e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:47.994136 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdc5cb-c1d3-45e5-9aff-a7eb3ec5f4cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:47.994755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdc5cb-c1d3-45e5-9aff-a7eb3ec5f4cf service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:47.995028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdc5cb-c1d3-45e5-9aff-a7eb3ec5f4cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:47.995295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdc5cb-c1d3-45e5-9aff-a7eb3ec5f4cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:48.005097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdc5cb-c1d3-45e5-9aff-a7eb3ec5f4cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:48.006535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdc5cb-c1d3-45e5-9aff-a7eb3ec5f4cf service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:48.016577 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 989/1978] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:28:50.828149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124464e6-bc86-43aa-86c1-94830414d850 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:50.828594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124464e6-bc86-43aa-86c1-94830414d850 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:50.828696 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124464e6-bc86-43aa-86c1-94830414d850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:50.860846 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-124464e6-bc86-43aa-86c1-94830414d850 None None] MFA Rules not processed for user `b0be683da08b4f379da60d4dd4a048ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:50.867496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-124464e6-bc86-43aa-86c1-94830414d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:50.957088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:51.065743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 990/1979] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:51.552249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c1d4-314b-4c81-87ab-e68ffa3c6ece None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:51.552783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c1d4-314b-4c81-87ab-e68ffa3c6ece None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:51.554789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c1d4-314b-4c81-87ab-e68ffa3c6ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:51.587981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3378c1d4-314b-4c81-87ab-e68ffa3c6ece None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:51.589462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3378c1d4-314b-4c81-87ab-e68ffa3c6ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:51.600899 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 990/1980] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:51.617484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124464e6-bc86-43aa-86c1-94830414d850 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:51.618981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-124464e6-bc86-43aa-86c1-94830414d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:51.726256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124464e6-bc86-43aa-86c1-94830414d850 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:51.734854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f4d55-5761-41f6-bca4-da797c330964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:51.735745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f4d55-5761-41f6-bca4-da797c330964 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:51.736093 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f4d55-5761-41f6-bca4-da797c330964 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:51.736958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f4d55-5761-41f6-bca4-da797c330964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:51.748520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f4d55-5761-41f6-bca4-da797c330964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:51.750359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f4d55-5761-41f6-bca4-da797c330964 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:51.763346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 991/1981] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:28:55.121269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5445d-5380-487d-a10c-67fb9d5c88e0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:55.121763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5445d-5380-487d-a10c-67fb9d5c88e0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:55.121871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5445d-5380-487d-a10c-67fb9d5c88e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:55.157362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-07b5445d-5380-487d-a10c-67fb9d5c88e0 None None] MFA Rules not processed for user `15dc4bbe837f49c2b854bf4306ea8cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:55.158578 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-07b5445d-5380-487d-a10c-67fb9d5c88e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:55.245718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 991/1982] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:28:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:28:55.250619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f4d55-5761-41f6-bca4-da797c330964 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:55.267702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f4d55-5761-41f6-bca4-da797c330964 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:55.276685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af649ff-cd29-49ce-92c6-f18b3180f626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:55.277947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af649ff-cd29-49ce-92c6-f18b3180f626 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:55.278175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af649ff-cd29-49ce-92c6-f18b3180f626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:55.278334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af649ff-cd29-49ce-92c6-f18b3180f626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:55.279216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af649ff-cd29-49ce-92c6-f18b3180f626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:55.282220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af649ff-cd29-49ce-92c6-f18b3180f626 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:55.325074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 992/1983] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:28:55 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:55.329318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5445d-5380-487d-a10c-67fb9d5c88e0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:55.343221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5445d-5380-487d-a10c-67fb9d5c88e0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:55.422422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:55.442065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3632a-5c9a-41ac-9f0f-5b10891ca726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:55.442861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3632a-5c9a-41ac-9f0f-5b10891ca726 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:55.443283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3632a-5c9a-41ac-9f0f-5b10891ca726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:55.443697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3632a-5c9a-41ac-9f0f-5b10891ca726 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:55.444472 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3632a-5c9a-41ac-9f0f-5b10891ca726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:55.446673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3632a-5c9a-41ac-9f0f-5b10891ca726 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:55.478404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 992/1984] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:28:55 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:28:55.482968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af649ff-cd29-49ce-92c6-f18b3180f626 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:55.496905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af649ff-cd29-49ce-92c6-f18b3180f626 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:55.502859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331a02d-08ed-426f-b1cd-fd5ea2e28136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:55.503478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331a02d-08ed-426f-b1cd-fd5ea2e28136 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:55.503803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331a02d-08ed-426f-b1cd-fd5ea2e28136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:55.504076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331a02d-08ed-426f-b1cd-fd5ea2e28136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:55.504766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331a02d-08ed-426f-b1cd-fd5ea2e28136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:55.506502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331a02d-08ed-426f-b1cd-fd5ea2e28136 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:55.520192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 993/1985] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:55.523651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3632a-5c9a-41ac-9f0f-5b10891ca726 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:55.535179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3632a-5c9a-41ac-9f0f-5b10891ca726 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:55.541761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2c9d0-16f7-46a6-a456-42ff0c70a81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:55.542874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2c9d0-16f7-46a6-a456-42ff0c70a81f admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:55.543060 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2c9d0-16f7-46a6-a456-42ff0c70a81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:55.543690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2c9d0-16f7-46a6-a456-42ff0c70a81f admin admin] PATH_INFO: `/v3/projects/2a2e7b489c7043d5ad66cf461d3f9753/users/6cb6e027ba724703929399d707142d1e/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:55.594592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2c9d0-16f7-46a6-a456-42ff0c70a81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2e7b489c7043d5ad66cf461d3f9753, user_id=6cb6e027ba724703929399d707142d1e, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:55.598223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2c9d0-16f7-46a6-a456-42ff0c70a81f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:55.613938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 993/1986] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:55 2022] PUT /identity/v3/projects/2a2e7b489c7043d5ad66cf461d3f9753/users/6cb6e027ba724703929399d707142d1e/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:55.618287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331a02d-08ed-426f-b1cd-fd5ea2e28136 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:55.629558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331a02d-08ed-426f-b1cd-fd5ea2e28136 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:55.694152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913c40f-6372-4087-af65-8ecc84bc3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:55.694763 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913c40f-6372-4087-af65-8ecc84bc3ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:55.695041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913c40f-6372-4087-af65-8ecc84bc3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:55.695311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913c40f-6372-4087-af65-8ecc84bc3ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:55.697132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913c40f-6372-4087-af65-8ecc84bc3ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:55.697819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913c40f-6372-4087-af65-8ecc84bc3ce7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:55.708550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 994/1987] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:28:55.712664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2c9d0-16f7-46a6-a456-42ff0c70a81f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:55.724373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2c9d0-16f7-46a6-a456-42ff0c70a81f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:55.729378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d6df1-9914-468d-8a14-736d87f58e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:55.730027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6df1-9914-468d-8a14-736d87f58e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:55.730304 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6df1-9914-468d-8a14-736d87f58e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:55.730580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6df1-9914-468d-8a14-736d87f58e55 admin admin] PATH_INFO: `/v3/projects/2a2e7b489c7043d5ad66cf461d3f9753/users/6cb6e027ba724703929399d707142d1e/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:55.732569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d6df1-9914-468d-8a14-736d87f58e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2e7b489c7043d5ad66cf461d3f9753, user_id=6cb6e027ba724703929399d707142d1e, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:55.734614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc435-fc73-4b97-b47a-61a846dc6985 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:55.735076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc435-fc73-4b97-b47a-61a846dc6985 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:55.735247 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d6df1-9914-468d-8a14-736d87f58e55 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:55.735753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc435-fc73-4b97-b47a-61a846dc6985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:55.753180 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 994/1988] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:28:55 2022] PUT /identity/v3/projects/2a2e7b489c7043d5ad66cf461d3f9753/users/6cb6e027ba724703929399d707142d1e/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:28:55.757477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0a6cc435-fc73-4b97-b47a-61a846dc6985 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:28:55.758817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0a6cc435-fc73-4b97-b47a-61a846dc6985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:55.781000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:55.834122 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 995/1989] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:28:55.855939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d6df1-9914-468d-8a14-736d87f58e55 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:28:55.858131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-413d6df1-9914-468d-8a14-736d87f58e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:28:55.956441 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d6df1-9914-468d-8a14-736d87f58e55 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:28:55.966293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7df83b-f2f5-4fc5-b3e1-cd1ffe949780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:28:55.966951 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7df83b-f2f5-4fc5-b3e1-cd1ffe949780 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:28:55.967396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7df83b-f2f5-4fc5-b3e1-cd1ffe949780 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:28:55.967585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7df83b-f2f5-4fc5-b3e1-cd1ffe949780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:28:55.977955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7df83b-f2f5-4fc5-b3e1-cd1ffe949780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:28:55.979948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7df83b-f2f5-4fc5-b3e1-cd1ffe949780 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:28:55.993140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 995/1990] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:29:01.499538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446f827-aa5c-4e74-968b-dfe4350aa7e8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:01.500141 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446f827-aa5c-4e74-968b-dfe4350aa7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:01.500573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446f827-aa5c-4e74-968b-dfe4350aa7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:01.541688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4446f827-aa5c-4e74-968b-dfe4350aa7e8 None None] MFA Rules not processed for user `6cb6e027ba724703929399d707142d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:01.543035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4446f827-aa5c-4e74-968b-dfe4350aa7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:01.623670 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 996/1991] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:29:01.637635 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7df83b-f2f5-4fc5-b3e1-cd1ffe949780 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:01.639913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9e7df83b-f2f5-4fc5-b3e1-cd1ffe949780 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:01.739958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7df83b-f2f5-4fc5-b3e1-cd1ffe949780 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:01.745607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c4795-c995-41af-8ac6-6e0d90f10af9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27a93c04181493593a069650a977773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:01.746647 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c4795-c995-41af-8ac6-6e0d90f10af9 service glance] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:01.746934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c4795-c995-41af-8ac6-6e0d90f10af9 service glance] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:01.747209 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c4795-c995-41af-8ac6-6e0d90f10af9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:01.786574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:01.878497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c4795-c995-41af-8ac6-6e0d90f10af9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:01.880737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c4795-c995-41af-8ac6-6e0d90f10af9 service glance] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:01.896143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 996/1992] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:29:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:29:02.218953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f043a9-c4e0-4418-8a9f-83a9a8c414b3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:02.219574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f043a9-c4e0-4418-8a9f-83a9a8c414b3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:02.219975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f043a9-c4e0-4418-8a9f-83a9a8c414b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:02.269471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-70f043a9-c4e0-4418-8a9f-83a9a8c414b3 None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:02.272138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-70f043a9-c4e0-4418-8a9f-83a9a8c414b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:02.450373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 997/1993] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:29:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:29:02.531006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c4795-c995-41af-8ac6-6e0d90f10af9 service glance] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:02.532905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-726c4795-c995-41af-8ac6-6e0d90f10af9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:02.709548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c4795-c995-41af-8ac6-6e0d90f10af9 service glance] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:02.715773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dd5ec-35e8-4f27-b2d0-b4a81e12e240 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:02.716483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dd5ec-35e8-4f27-b2d0-b4a81e12e240 service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:02.716766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dd5ec-35e8-4f27-b2d0-b4a81e12e240 service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:02.717060 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dd5ec-35e8-4f27-b2d0-b4a81e12e240 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:02.736308 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dd5ec-35e8-4f27-b2d0-b4a81e12e240 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:02.740233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dd5ec-35e8-4f27-b2d0-b4a81e12e240 service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:02.777433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 997/1994] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:29:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:29:03.467568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f551f-5a63-48ec-b5cc-6c895e09d8e1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:03.468870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f551f-5a63-48ec-b5cc-6c895e09d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:03.469360 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f551f-5a63-48ec-b5cc-6c895e09d8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:03.515851 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7f8f551f-5a63-48ec-b5cc-6c895e09d8e1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:03.517527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7f8f551f-5a63-48ec-b5cc-6c895e09d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:03.541345 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 998/1995] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:03.599057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dd5ec-35e8-4f27-b2d0-b4a81e12e240 service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:03.620109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dd5ec-35e8-4f27-b2d0-b4a81e12e240 service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:03.634297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816947f-39f3-484f-8ff4-2316be8b2505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:03.635407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816947f-39f3-484f-8ff4-2316be8b2505 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:03.635845 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816947f-39f3-484f-8ff4-2316be8b2505 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:03.636271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816947f-39f3-484f-8ff4-2316be8b2505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:03.652445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816947f-39f3-484f-8ff4-2316be8b2505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:03.675539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816947f-39f3-484f-8ff4-2316be8b2505 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:03.700969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 998/1996] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:29:12.856020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd010c5-4183-46b3-9d96-1f9d4c55c064 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:12.856569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd010c5-4183-46b3-9d96-1f9d4c55c064 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:12.856569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd010c5-4183-46b3-9d96-1f9d4c55c064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:12.901075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1dd010c5-4183-46b3-9d96-1f9d4c55c064 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:12.902722 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1dd010c5-4183-46b3-9d96-1f9d4c55c064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:12.919287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 999/1997] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:12.973396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816947f-39f3-484f-8ff4-2316be8b2505 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:12.986340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816947f-39f3-484f-8ff4-2316be8b2505 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:12.993701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58251de7-366d-4e5f-8139-7bdcc2c7ab5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:12.994407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58251de7-366d-4e5f-8139-7bdcc2c7ab5f service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:12.994747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58251de7-366d-4e5f-8139-7bdcc2c7ab5f service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:12.995086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58251de7-366d-4e5f-8139-7bdcc2c7ab5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:13.004875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58251de7-366d-4e5f-8139-7bdcc2c7ab5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:13.006601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58251de7-366d-4e5f-8139-7bdcc2c7ab5f service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:13.017917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 999/1998] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:29:13.388784 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9fe16-12e0-49f7-ab98-17e9f4761bf6 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:13.389336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9fe16-12e0-49f7-ab98-17e9f4761bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:13.389848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9fe16-12e0-49f7-ab98-17e9f4761bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:13.415853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6db9fe16-12e0-49f7-ab98-17e9f4761bf6 None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:13.417622 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6db9fe16-12e0-49f7-ab98-17e9f4761bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:13.427194 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1000/1999] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:29:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:13.447140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58251de7-366d-4e5f-8139-7bdcc2c7ab5f service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:13.468122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58251de7-366d-4e5f-8139-7bdcc2c7ab5f service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:13.476154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa882f-6e69-4a87-9450-8f54fb3d2bf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:13.477375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa882f-6e69-4a87-9450-8f54fb3d2bf6 service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:13.477734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa882f-6e69-4a87-9450-8f54fb3d2bf6 service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:13.478079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa882f-6e69-4a87-9450-8f54fb3d2bf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:13.491942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa882f-6e69-4a87-9450-8f54fb3d2bf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:13.495270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa882f-6e69-4a87-9450-8f54fb3d2bf6 service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:13.507215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1000/2000] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:29:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:29:14.411540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2d4ad-911d-4732-aba4-c309561be34c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:14.412563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2d4ad-911d-4732-aba4-c309561be34c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:14.413035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2d4ad-911d-4732-aba4-c309561be34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:14.475727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-77b2d4ad-911d-4732-aba4-c309561be34c None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:14.477230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-77b2d4ad-911d-4732-aba4-c309561be34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:14.509326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1001/2001] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 07:29:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:14.538113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa882f-6e69-4a87-9450-8f54fb3d2bf6 service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:14.555717 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa882f-6e69-4a87-9450-8f54fb3d2bf6 service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:14.562235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00224315-8178-41fd-9195-ca4b2272d767 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:14.562937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00224315-8178-41fd-9195-ca4b2272d767 service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:14.563402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00224315-8178-41fd-9195-ca4b2272d767 service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:14.563834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00224315-8178-41fd-9195-ca4b2272d767 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:14.578197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00224315-8178-41fd-9195-ca4b2272d767 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:14.580111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00224315-8178-41fd-9195-ca4b2272d767 service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:14.611457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1001/2002] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:29:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:29:15.000564 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81775914-2d41-4759-8105-866115988f35 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:15.000931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81775914-2d41-4759-8105-866115988f35 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:15.001314 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81775914-2d41-4759-8105-866115988f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:15.022771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-81775914-2d41-4759-8105-866115988f35 None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:15.024392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-81775914-2d41-4759-8105-866115988f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:15.032334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1002/2003] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:29:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:15.051382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00224315-8178-41fd-9195-ca4b2272d767 service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:15.063069 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00224315-8178-41fd-9195-ca4b2272d767 service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:15.073090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af7cd5-369e-498c-99bc-e4a22caf8590 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:15.074078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7cd5-369e-498c-99bc-e4a22caf8590 service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:15.074451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7cd5-369e-498c-99bc-e4a22caf8590 service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:15.074773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7cd5-369e-498c-99bc-e4a22caf8590 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:15.084962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af7cd5-369e-498c-99bc-e4a22caf8590 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:15.088719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af7cd5-369e-498c-99bc-e4a22caf8590 service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:15.098680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1002/2004] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:29:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:29:15.619550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d828d-0842-40ee-b3f9-a46dd953d94e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:15.620158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d828d-0842-40ee-b3f9-a46dd953d94e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:15.620158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d828d-0842-40ee-b3f9-a46dd953d94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:15.642855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a44d828d-0842-40ee-b3f9-a46dd953d94e None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:15.643898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800146fb-6d1b-44af-92cc-6a354e11b0b6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:15.644379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a44d828d-0842-40ee-b3f9-a46dd953d94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:15.644504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800146fb-6d1b-44af-92cc-6a354e11b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:15.644504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800146fb-6d1b-44af-92cc-6a354e11b0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:15.653973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1003/2005] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 07:29:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:15.669130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d828d-0842-40ee-b3f9-a46dd953d94e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:15.682757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-800146fb-6d1b-44af-92cc-6a354e11b0b6 None None] MFA Rules not processed for user `15dc4bbe837f49c2b854bf4306ea8cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:15.683974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-800146fb-6d1b-44af-92cc-6a354e11b0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:15.685915 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d828d-0842-40ee-b3f9-a46dd953d94e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:15.691945 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1003/2006] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:29:15.693856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc787c-123f-4658-b348-13b8b0a7874d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:15.694684 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc787c-123f-4658-b348-13b8b0a7874d service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:15.695311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc787c-123f-4658-b348-13b8b0a7874d service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:15.696107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc787c-123f-4658-b348-13b8b0a7874d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:15.708100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc787c-123f-4658-b348-13b8b0a7874d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:15.709738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc787c-123f-4658-b348-13b8b0a7874d service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:15.732154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:15.741773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1004/2007] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:29:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:29:18.157162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653468a1-8bbf-4b6c-8e1f-0350b784a85f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:18.157625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653468a1-8bbf-4b6c-8e1f-0350b784a85f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:18.157756 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653468a1-8bbf-4b6c-8e1f-0350b784a85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:18.184987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-653468a1-8bbf-4b6c-8e1f-0350b784a85f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:18.186444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-653468a1-8bbf-4b6c-8e1f-0350b784a85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:18.196675 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1004/2008] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:18.238102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc787c-123f-4658-b348-13b8b0a7874d service swift] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:18.256852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc787c-123f-4658-b348-13b8b0a7874d service swift] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:18.258815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653468a1-8bbf-4b6c-8e1f-0350b784a85f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:18.260917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-653468a1-8bbf-4b6c-8e1f-0350b784a85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:18.265313 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754647f-4127-4e9c-86c9-4dc3bc1ab211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:18.265944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754647f-4127-4e9c-86c9-4dc3bc1ab211 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:18.266239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754647f-4127-4e9c-86c9-4dc3bc1ab211 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:18.266497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754647f-4127-4e9c-86c9-4dc3bc1ab211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:18.277187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653468a1-8bbf-4b6c-8e1f-0350b784a85f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:18.281379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754647f-4127-4e9c-86c9-4dc3bc1ab211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:18.282777 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:18.284082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:18.284350 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:18.284815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] PATH_INFO: `/v3/users/c57a7fdac4554d39aba864be2c824e40` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:18.285751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754647f-4127-4e9c-86c9-4dc3bc1ab211 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:18.286330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c57a7fdac4554d39aba864be2c824e40)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:18.288462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:18.301802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1005/2009] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:29:18.337698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:18.347031 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c57a7fdac4554d39aba864be2c824e40'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:29:18.355391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c57a7fdac4554d39aba864be2c824e40'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:29:18.356338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c57a7fdac4554d39aba864be2c824e40'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:29:18.369063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c57a7fdac4554d39aba864be2c824e40'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:29:18.375891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c57a7fdac4554d39aba864be2c824e40'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:29:18.382812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1005/2010] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:29:18 2022] DELETE /identity/v3/users/c57a7fdac4554d39aba864be2c824e40 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:29:18.387469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7443ae-b2fd-4be2-887b-7323bc72d7c1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:18.387758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7443ae-b2fd-4be2-887b-7323bc72d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:18.388033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7443ae-b2fd-4be2-887b-7323bc72d7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:18.407752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1c7443ae-b2fd-4be2-887b-7323bc72d7c1 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:18.410105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1c7443ae-b2fd-4be2-887b-7323bc72d7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:18.474988 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1006/2011] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:18.481619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:18.483072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:18.545704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080bf4c-560e-48af-885f-a7bdd774ec6d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:18.550797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cedfcc-b573-4acc-a4bc-c6b13b192ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:18.551430 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cedfcc-b573-4acc-a4bc-c6b13b192ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:18.551698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cedfcc-b573-4acc-a4bc-c6b13b192ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:18.551984 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cedfcc-b573-4acc-a4bc-c6b13b192ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:18.562436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cedfcc-b573-4acc-a4bc-c6b13b192ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:18.563955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cedfcc-b573-4acc-a4bc-c6b13b192ac8 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:18.574775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1006/2012] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:29:18.775645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7443ae-b2fd-4be2-887b-7323bc72d7c1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:18.777390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1c7443ae-b2fd-4be2-887b-7323bc72d7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:18.790818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7443ae-b2fd-4be2-887b-7323bc72d7c1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:18.796612 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:18.797834 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:18.798268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:18.798690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] PATH_INFO: `/v3/projects/64b2131e236b49e18d929e4e715184c0` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:18.803293 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b2131e236b49e18d929e4e715184c0)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:18.806082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:18.862387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b2131e236b49e18d929e4e715184c0', 'request_id': 'req-4edb9748-8a9e-4668-9ec1-7390496383e7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:29:18.867961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b2131e236b49e18d929e4e715184c0', 'request_id': 'req-4edb9748-8a9e-4668-9ec1-7390496383e7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:29:18.874169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b2131e236b49e18d929e4e715184c0', 'request_id': 'req-4edb9748-8a9e-4668-9ec1-7390496383e7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:29:18.886659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] The token cache is being invalidate because project 64b2131e236b49e18d929e4e715184c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:29:18.886944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:29:18.887552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4edb9748-8a9e-4668-9ec1-7390496383e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:29:18.889021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1007/2013] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:29:18 2022] DELETE /identity/v3/projects/64b2131e236b49e18d929e4e715184c0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:29:18.894212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f200b6-1a1d-46b0-986d-6db1593dada4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:18.894495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f200b6-1a1d-46b0-986d-6db1593dada4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:18.894770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f200b6-1a1d-46b0-986d-6db1593dada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:18.915379 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e6f200b6-1a1d-46b0-986d-6db1593dada4 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:18.916576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e6f200b6-1a1d-46b0-986d-6db1593dada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:18.975221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1007/2014] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:18.983131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01d6b-186d-4912-b86f-936de06b933b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:18.983349 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01d6b-186d-4912-b86f-936de06b933b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:18.983642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01d6b-186d-4912-b86f-936de06b933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:19.004239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-89d01d6b-186d-4912-b86f-936de06b933b None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:19.005483 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-89d01d6b-186d-4912-b86f-936de06b933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:19.013164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1008/2015] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:19.017344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f200b6-1a1d-46b0-986d-6db1593dada4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:19.026905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f200b6-1a1d-46b0-986d-6db1593dada4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:19.031406 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091617ec-8fef-433e-8d5e-b079f5b0327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:19.031994 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091617ec-8fef-433e-8d5e-b079f5b0327a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:19.032268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091617ec-8fef-433e-8d5e-b079f5b0327a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:19.032537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091617ec-8fef-433e-8d5e-b079f5b0327a admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:19.033284 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091617ec-8fef-433e-8d5e-b079f5b0327a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:29:19.033871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091617ec-8fef-433e-8d5e-b079f5b0327a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:19.035189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091617ec-8fef-433e-8d5e-b079f5b0327a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:19.046442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1008/2016] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:29:19.051076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d01d6b-186d-4912-b86f-936de06b933b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:19.060248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d01d6b-186d-4912-b86f-936de06b933b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:19.065743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93864000-efea-4afc-adec-70e36c2c770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:19.066314 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93864000-efea-4afc-adec-70e36c2c770f admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:19.066592 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93864000-efea-4afc-adec-70e36c2c770f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:19.066859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93864000-efea-4afc-adec-70e36c2c770f admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:19.067496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93864000-efea-4afc-adec-70e36c2c770f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:19.069447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93864000-efea-4afc-adec-70e36c2c770f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:19.096198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1009/2017] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:29:19 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:29:19.100539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091617ec-8fef-433e-8d5e-b079f5b0327a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:19.110197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091617ec-8fef-433e-8d5e-b079f5b0327a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:19.143121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:19.169395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ca28-8982-40f0-bd9b-13e94fa5c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:19.170040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ca28-8982-40f0-bd9b-13e94fa5c022 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:19.170315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ca28-8982-40f0-bd9b-13e94fa5c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:19.170584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ca28-8982-40f0-bd9b-13e94fa5c022 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:19.171208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ca28-8982-40f0-bd9b-13e94fa5c022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:19.173172 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ca28-8982-40f0-bd9b-13e94fa5c022 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:19.195937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1009/2018] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:29:19 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:29:19.200508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93864000-efea-4afc-adec-70e36c2c770f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:19.210927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93864000-efea-4afc-adec-70e36c2c770f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:19.215500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0ff22-bb6a-4362-b555-3110f229bd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:19.216088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0ff22-bb6a-4362-b555-3110f229bd9d admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:19.216365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0ff22-bb6a-4362-b555-3110f229bd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:19.216636 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0ff22-bb6a-4362-b555-3110f229bd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:19.217297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0ff22-bb6a-4362-b555-3110f229bd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:19.218929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0ff22-bb6a-4362-b555-3110f229bd9d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:19.228977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1010/2019] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:29:19.232677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ca28-8982-40f0-bd9b-13e94fa5c022 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:19.243318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ca28-8982-40f0-bd9b-13e94fa5c022 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:19.247927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4aa95d-d1cb-4dc2-8ca8-cf20eea93259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:19.248520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4aa95d-d1cb-4dc2-8ca8-cf20eea93259 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:19.248798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4aa95d-d1cb-4dc2-8ca8-cf20eea93259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:19.249091 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4aa95d-d1cb-4dc2-8ca8-cf20eea93259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:19.249723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4aa95d-d1cb-4dc2-8ca8-cf20eea93259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:19.251298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4aa95d-d1cb-4dc2-8ca8-cf20eea93259 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:19.262456 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1010/2020] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:29:19.266672 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0ff22-bb6a-4362-b555-3110f229bd9d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:19.276823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0ff22-bb6a-4362-b555-3110f229bd9d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:19.281731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e2587-8bf3-4ff8-be1a-cf59051a2560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:19.282374 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e2587-8bf3-4ff8-be1a-cf59051a2560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:19.282646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e2587-8bf3-4ff8-be1a-cf59051a2560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:19.282916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e2587-8bf3-4ff8-be1a-cf59051a2560 admin admin] PATH_INFO: `/v3/projects/86cbadf9f51c4bc5ad053c5d34534928/users/8f0df868bfde4164bb2b8f79849516d8/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:19.297903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e2587-8bf3-4ff8-be1a-cf59051a2560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86cbadf9f51c4bc5ad053c5d34534928, user_id=8f0df868bfde4164bb2b8f79849516d8, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:19.301107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e2587-8bf3-4ff8-be1a-cf59051a2560 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:19.314324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1011/2021] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:29:19 2022] PUT /identity/v3/projects/86cbadf9f51c4bc5ad053c5d34534928/users/8f0df868bfde4164bb2b8f79849516d8/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:29:19.319451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70ce8-e6a5-4aa3-98d9-dacd24793d30 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:19.319810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70ce8-e6a5-4aa3-98d9-dacd24793d30 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:19.320149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70ce8-e6a5-4aa3-98d9-dacd24793d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:19.339503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9cb70ce8-e6a5-4aa3-98d9-dacd24793d30 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:19.340753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9cb70ce8-e6a5-4aa3-98d9-dacd24793d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:19.402880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1011/2022] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:19.413135 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e2587-8bf3-4ff8-be1a-cf59051a2560 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:19.414970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d94e2587-8bf3-4ff8-be1a-cf59051a2560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:19.428415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:19.479350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e2587-8bf3-4ff8-be1a-cf59051a2560 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:19.482991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fef6b6-5458-49ea-83bf-6db68f1cf8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:19.483594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fef6b6-5458-49ea-83bf-6db68f1cf8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:19.483869 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fef6b6-5458-49ea-83bf-6db68f1cf8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:19.484139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fef6b6-5458-49ea-83bf-6db68f1cf8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:19.493927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fef6b6-5458-49ea-83bf-6db68f1cf8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:19.495292 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fef6b6-5458-49ea-83bf-6db68f1cf8c9 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:19.504999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1012/2023] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:29:21.084316 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dba9-8aab-440d-8f43-e62ba0ef3396 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:21.084787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dba9-8aab-440d-8f43-e62ba0ef3396 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:21.084867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dba9-8aab-440d-8f43-e62ba0ef3396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:21.118776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e7e6dba9-8aab-440d-8f43-e62ba0ef3396 None None] MFA Rules not processed for user `4eba12ea4c4245099fea1e3be288c683`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:21.119917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e7e6dba9-8aab-440d-8f43-e62ba0ef3396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:21.207384 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1012/2024] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:23.349400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5b886-33cb-4a7a-b855-a853c2943fcc None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:23.349982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5b886-33cb-4a7a-b855-a853c2943fcc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:23.350303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5b886-33cb-4a7a-b855-a853c2943fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:23.392178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ace5b886-33cb-4a7a-b855-a853c2943fcc None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:23.394121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ace5b886-33cb-4a7a-b855-a853c2943fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:23.548385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49039-7117-47c4-b623-3f6c4c3e604c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:23.549529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49039-7117-47c4-b623-3f6c4c3e604c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:23.549672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff49039-7117-47c4-b623-3f6c4c3e604c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:23.567103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1013/2025] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:29:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:23.582142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5b886-33cb-4a7a-b855-a853c2943fcc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:23.583807 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ace5b886-33cb-4a7a-b855-a853c2943fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:23.592239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cff49039-7117-47c4-b623-3f6c4c3e604c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:23.595147 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cff49039-7117-47c4-b623-3f6c4c3e604c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:23.620153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1013/2026] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:29:23.715631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5b886-33cb-4a7a-b855-a853c2943fcc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:23.722884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff49039-7117-47c4-b623-3f6c4c3e604c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:23.724555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cff49039-7117-47c4-b623-3f6c4c3e604c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:23.728854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0dde6-5fe5-4d43-bf18-17aea88ec2fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:23.729585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0dde6-5fe5-4d43-bf18-17aea88ec2fc service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:23.729857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0dde6-5fe5-4d43-bf18-17aea88ec2fc service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:23.730121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0dde6-5fe5-4d43-bf18-17aea88ec2fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:23.754166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0dde6-5fe5-4d43-bf18-17aea88ec2fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:23.755958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0dde6-5fe5-4d43-bf18-17aea88ec2fc service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:23.773631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1014/2027] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:29:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:29:23.838970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:23.917894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff49039-7117-47c4-b623-3f6c4c3e604c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:23.932644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf1ce1-1a79-4ab6-9155-f4bdf96ab331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:23.933649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf1ce1-1a79-4ab6-9155-f4bdf96ab331 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:23.937417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf1ce1-1a79-4ab6-9155-f4bdf96ab331 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:23.938058 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf1ce1-1a79-4ab6-9155-f4bdf96ab331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:23.972119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf1ce1-1a79-4ab6-9155-f4bdf96ab331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:23.974107 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf1ce1-1a79-4ab6-9155-f4bdf96ab331 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:24.000360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1014/2028] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:29:26.144103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755995c2-909e-47d7-80a0-32ad6da54584 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:26.145576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755995c2-909e-47d7-80a0-32ad6da54584 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:26.146145 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755995c2-909e-47d7-80a0-32ad6da54584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:26.206641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-755995c2-909e-47d7-80a0-32ad6da54584 None None] MFA Rules not processed for user `8f0df868bfde4164bb2b8f79849516d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:26.208521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-755995c2-909e-47d7-80a0-32ad6da54584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:26.281562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:26.352860 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1015/2029] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:26.357165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf1ce1-1a79-4ab6-9155-f4bdf96ab331 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:26.370317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf1ce1-1a79-4ab6-9155-f4bdf96ab331 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:26.382109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e08b9-fa12-4f2d-9f81-245b6670b325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:26.382907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e08b9-fa12-4f2d-9f81-245b6670b325 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:26.386333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e08b9-fa12-4f2d-9f81-245b6670b325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:26.386830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e08b9-fa12-4f2d-9f81-245b6670b325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:26.387743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e08b9-fa12-4f2d-9f81-245b6670b325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:26.399649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e08b9-fa12-4f2d-9f81-245b6670b325 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:26.469306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1015/2030] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:29:26 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:29:26.470603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755995c2-909e-47d7-80a0-32ad6da54584 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:26.489362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755995c2-909e-47d7-80a0-32ad6da54584 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:26.595152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e10b-ed06-4419-a1d7-0e3fc937903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:26.596121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e10b-ed06-4419-a1d7-0e3fc937903c admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:26.596641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e10b-ed06-4419-a1d7-0e3fc937903c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:26.599370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e10b-ed06-4419-a1d7-0e3fc937903c admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:26.600200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446e10b-ed06-4419-a1d7-0e3fc937903c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:26.602326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446e10b-ed06-4419-a1d7-0e3fc937903c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:26.636614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1016/2031] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:29:26 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:29:26.638121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e08b9-fa12-4f2d-9f81-245b6670b325 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:26.665529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e08b9-fa12-4f2d-9f81-245b6670b325 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:26.673413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a471f-f513-474b-93a7-d434e5db562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:26.675030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a471f-f513-474b-93a7-d434e5db562c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:26.675411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a471f-f513-474b-93a7-d434e5db562c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:26.675776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a471f-f513-474b-93a7-d434e5db562c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:26.676525 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a471f-f513-474b-93a7-d434e5db562c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:26.678287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a471f-f513-474b-93a7-d434e5db562c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:26.706454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e10b-ed06-4419-a1d7-0e3fc937903c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:26.708706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1016/2032] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:29:26.726409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e10b-ed06-4419-a1d7-0e3fc937903c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:26.731459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860d63-e709-445c-8bbc-8ee0af6978f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:26.732287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860d63-e709-445c-8bbc-8ee0af6978f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:26.732664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860d63-e709-445c-8bbc-8ee0af6978f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:26.733045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860d63-e709-445c-8bbc-8ee0af6978f2 admin admin] PATH_INFO: `/v3/projects/ca176b27269a4b678306733635c08d0d/users/516b908b95c043cbbae6583e8e599179/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:26.764291 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef860d63-e709-445c-8bbc-8ee0af6978f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca176b27269a4b678306733635c08d0d, user_id=516b908b95c043cbbae6583e8e599179, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:26.768972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef860d63-e709-445c-8bbc-8ee0af6978f2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:26.791598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1017/2033] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:29:26 2022] PUT /identity/v3/projects/ca176b27269a4b678306733635c08d0d/users/516b908b95c043cbbae6583e8e599179/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:29:26.796204 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a471f-f513-474b-93a7-d434e5db562c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:26.812509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a471f-f513-474b-93a7-d434e5db562c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:26.955481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eaf12-06e2-458b-ada7-0748b95a5f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:26.956852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eaf12-06e2-458b-ada7-0748b95a5f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:26.957629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eaf12-06e2-458b-ada7-0748b95a5f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:26.957909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eaf12-06e2-458b-ada7-0748b95a5f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:26.958562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1eaf12-06e2-458b-ada7-0748b95a5f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:26.960171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1eaf12-06e2-458b-ada7-0748b95a5f7f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:26.983682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860d63-e709-445c-8bbc-8ee0af6978f2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:26.985074 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1017/2034] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:29:27.006181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860d63-e709-445c-8bbc-8ee0af6978f2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:27.013385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061cc74-a49b-4f93-b68f-bce2a97bda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:27.014200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061cc74-a49b-4f93-b68f-bce2a97bda6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:27.014573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061cc74-a49b-4f93-b68f-bce2a97bda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:27.014940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061cc74-a49b-4f93-b68f-bce2a97bda6b admin admin] PATH_INFO: `/v3/projects/ca176b27269a4b678306733635c08d0d/users/516b908b95c043cbbae6583e8e599179/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:27.017028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061cc74-a49b-4f93-b68f-bce2a97bda6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca176b27269a4b678306733635c08d0d, user_id=516b908b95c043cbbae6583e8e599179, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:27.021041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061cc74-a49b-4f93-b68f-bce2a97bda6b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:27.035503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1018/2035] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:29:26 2022] PUT /identity/v3/projects/ca176b27269a4b678306733635c08d0d/users/516b908b95c043cbbae6583e8e599179/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:29:34.418721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1fb9d-86ab-4dfd-94de-d197f02df4ac None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:34.419311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1fb9d-86ab-4dfd-94de-d197f02df4ac None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:34.419311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1fb9d-86ab-4dfd-94de-d197f02df4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:34.451275 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-11e1fb9d-86ab-4dfd-94de-d197f02df4ac None None] MFA Rules not processed for user `516b908b95c043cbbae6583e8e599179`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:34.452667 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-11e1fb9d-86ab-4dfd-94de-d197f02df4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:34.528165 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1018/2036] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:34.544226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061cc74-a49b-4f93-b68f-bce2a97bda6b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:34.625821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061cc74-a49b-4f93-b68f-bce2a97bda6b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:34.632481 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8303f83-95b4-470a-a0d8-f24116243454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:34.633133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8303f83-95b4-470a-a0d8-f24116243454 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:34.633408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8303f83-95b4-470a-a0d8-f24116243454 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:34.633677 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8303f83-95b4-470a-a0d8-f24116243454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:34.662427 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:34.709155 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8303f83-95b4-470a-a0d8-f24116243454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:34.710755 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8303f83-95b4-470a-a0d8-f24116243454 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:34.720938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1019/2037] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:29:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:29:36.327190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9896a-7692-4941-919e-d162b1217e65 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:36.327736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9896a-7692-4941-919e-d162b1217e65 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:36.327736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9896a-7692-4941-919e-d162b1217e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:36.372688 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-09d9896a-7692-4941-919e-d162b1217e65 None None] MFA Rules not processed for user `8f0df868bfde4164bb2b8f79849516d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:36.374673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-09d9896a-7692-4941-919e-d162b1217e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:36.405755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1019/2038] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:29:44.715715 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=17 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:46.362585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:54.271791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4b5b-654f-48e4-8315-7272acb0a2b3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:54.272328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4b5b-654f-48e4-8315-7272acb0a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:54.272328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4b5b-654f-48e4-8315-7272acb0a2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:54.296380 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d0ec4b5b-654f-48e4-8315-7272acb0a2b3 None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:54.299609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d0ec4b5b-654f-48e4-8315-7272acb0a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:54.385222 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1020/2039] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:29:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:29:54.398970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9896a-7692-4941-919e-d162b1217e65 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:54.474998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9896a-7692-4941-919e-d162b1217e65 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:54.480239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8a9c4-85aa-4cb9-84c0-ab44c4b287c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:54.480882 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8a9c4-85aa-4cb9-84c0-ab44c4b287c8 service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:54.481161 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8a9c4-85aa-4cb9-84c0-ab44c4b287c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:54.481438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8a9c4-85aa-4cb9-84c0-ab44c4b287c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:54.490627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8a9c4-85aa-4cb9-84c0-ab44c4b287c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:54.492776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8a9c4-85aa-4cb9-84c0-ab44c4b287c8 service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:54.500538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1020/2040] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:29:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:29:56.047267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec4b5b-654f-48e4-8315-7272acb0a2b3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:56.049443 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d0ec4b5b-654f-48e4-8315-7272acb0a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:56.211170 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec4b5b-654f-48e4-8315-7272acb0a2b3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:56.224743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1324bd-b082-4670-9f33-de378eebc6a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:56.225694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1324bd-b082-4670-9f33-de378eebc6a7 service placement] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:56.226452 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1324bd-b082-4670-9f33-de378eebc6a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:56.227790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1324bd-b082-4670-9f33-de378eebc6a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:56.231585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ae1324bd-b082-4670-9f33-de378eebc6a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:56.255865 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1324bd-b082-4670-9f33-de378eebc6a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:56.257703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1324bd-b082-4670-9f33-de378eebc6a7 service placement] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:56.290358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1021/2041] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:29:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:29:56.341611 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8a9c4-85aa-4cb9-84c0-ab44c4b287c8 service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:29:56.343401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7da8a9c4-85aa-4cb9-84c0-ab44c4b287c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:56.413851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8a9c4-85aa-4cb9-84c0-ab44c4b287c8 service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:29:56.419271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4af76-a930-46ff-885f-4b3b6b06e8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:29:56.420204 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4af76-a930-46ff-885f-4b3b6b06e8aa service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:56.420649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4af76-a930-46ff-885f-4b3b6b06e8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:56.421117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4af76-a930-46ff-885f-4b3b6b06e8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:56.423802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-bfd4af76-a930-46ff-885f-4b3b6b06e8aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:56.508335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4af76-a930-46ff-885f-4b3b6b06e8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:29:56.509731 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4af76-a930-46ff-885f-4b3b6b06e8aa service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:29:56.521047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1021/2042] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:29:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:29:56.793874 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841bbea-5c08-44a6-93ed-fe0ceed05d9c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:29:56.794203 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841bbea-5c08-44a6-93ed-fe0ceed05d9c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:29:56.794425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841bbea-5c08-44a6-93ed-fe0ceed05d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:29:56.840105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c841bbea-5c08-44a6-93ed-fe0ceed05d9c None None] MFA Rules not processed for user `977979e33b244cf8aceff6eddc8653b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:29:56.841966 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c841bbea-5c08-44a6-93ed-fe0ceed05d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:29:57.004889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1022/2043] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:29:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:06.515810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=82 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:06.971496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=82 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:15.033736 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4af76-a930-46ff-885f-4b3b6b06e8aa service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:15.045276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4af76-a930-46ff-885f-4b3b6b06e8aa service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:15.052449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac6b1a-64f2-4545-82dd-961722665ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:15.053441 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac6b1a-64f2-4545-82dd-961722665ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:15.053931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac6b1a-64f2-4545-82dd-961722665ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:15.054431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac6b1a-64f2-4545-82dd-961722665ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:15.066827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac6b1a-64f2-4545-82dd-961722665ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:15.069176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac6b1a-64f2-4545-82dd-961722665ad8 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:15.094222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1022/2044] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:30:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:30:16.335623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4f9c6-64c7-44e7-99ad-0ee91fa13182 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:16.336169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4f9c6-64c7-44e7-99ad-0ee91fa13182 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:16.336169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4f9c6-64c7-44e7-99ad-0ee91fa13182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:16.382184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1dd4f9c6-64c7-44e7-99ad-0ee91fa13182 None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:16.383709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1dd4f9c6-64c7-44e7-99ad-0ee91fa13182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:16.392105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1023/2045] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 07:30:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:16.410548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac6b1a-64f2-4545-82dd-961722665ad8 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:16.439622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac6b1a-64f2-4545-82dd-961722665ad8 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:16.454371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971a45-fac4-4347-a7fd-f7e808305d3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:16.455463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971a45-fac4-4347-a7fd-f7e808305d3a service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:16.455748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971a45-fac4-4347-a7fd-f7e808305d3a service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:16.456069 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971a45-fac4-4347-a7fd-f7e808305d3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:16.498999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75971a45-fac4-4347-a7fd-f7e808305d3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:16.503232 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75971a45-fac4-4347-a7fd-f7e808305d3a service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:16.531382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1023/2046] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:30:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:30:19.371313 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5c852-3a38-45cd-8df6-6c24025331b5 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:19.371820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5c852-3a38-45cd-8df6-6c24025331b5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:19.371820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5c852-3a38-45cd-8df6-6c24025331b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:19.396334 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971a45-fac4-4347-a7fd-f7e808305d3a service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:19.400846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-75971a45-fac4-4347-a7fd-f7e808305d3a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:19.421240 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c7b5c852-3a38-45cd-8df6-6c24025331b5 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:19.422776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c7b5c852-3a38-45cd-8df6-6c24025331b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:19.519415 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75971a45-fac4-4347-a7fd-f7e808305d3a service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:19.524958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:19.526043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:19.526477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:19.526946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] PATH_INFO: `/v3/users/b0be683da08b4f379da60d4dd4a048ec` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:19.528256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0be683da08b4f379da60d4dd4a048ec)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:19.530433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:19.538692 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1024/2047] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:19.554838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5c852-3a38-45cd-8df6-6c24025331b5 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:19.580066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5c852-3a38-45cd-8df6-6c24025331b5 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:19.594668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0be683da08b4f379da60d4dd4a048ec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:19.596042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd8f42-d1c6-4544-8ba9-864f7c757100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:19.596777 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd8f42-d1c6-4544-8ba9-864f7c757100 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:19.597274 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd8f42-d1c6-4544-8ba9-864f7c757100 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:19.598328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd8f42-d1c6-4544-8ba9-864f7c757100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:19.608524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0be683da08b4f379da60d4dd4a048ec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:19.609420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0be683da08b4f379da60d4dd4a048ec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:19.618282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd8f42-d1c6-4544-8ba9-864f7c757100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:19.621001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd8f42-d1c6-4544-8ba9-864f7c757100 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:19.634048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0be683da08b4f379da60d4dd4a048ec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:19.639062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1025/2048] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:30:19.646189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-16532ede-2416-4a2a-84ac-9448bc716c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0be683da08b4f379da60d4dd4a048ec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:19.656289 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1024/2049] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:30:19 2022] DELETE /identity/v3/users/b0be683da08b4f379da60d4dd4a048ec => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:30:19.866749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd8f42-d1c6-4544-8ba9-864f7c757100 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:19.877783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd8f42-d1c6-4544-8ba9-864f7c757100 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:19.961883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:19.962527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:19.963061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:19.963339 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] PATH_INFO: `/v3/projects/96bd293a30b34629a1b01d46c32160d7` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:19.964482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96bd293a30b34629a1b01d46c32160d7)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:19.966494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:20.025269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96bd293a30b34629a1b01d46c32160d7', 'request_id': 'req-61b05f6d-7257-492d-9d30-69081fa8203f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:20.033334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96bd293a30b34629a1b01d46c32160d7', 'request_id': 'req-61b05f6d-7257-492d-9d30-69081fa8203f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:20.042149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96bd293a30b34629a1b01d46c32160d7', 'request_id': 'req-61b05f6d-7257-492d-9d30-69081fa8203f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:20.059532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] The token cache is being invalidate because project 96bd293a30b34629a1b01d46c32160d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:30:20.060236 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:20.061059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-61b05f6d-7257-492d-9d30-69081fa8203f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:20.062547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1026/2050] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:30:19 2022] DELETE /identity/v3/projects/96bd293a30b34629a1b01d46c32160d7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:30:20.068902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de5f5-e8de-49b8-9cc6-f7c98fa7bc14 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:20.069569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de5f5-e8de-49b8-9cc6-f7c98fa7bc14 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:20.069880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03de5f5-e8de-49b8-9cc6-f7c98fa7bc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:20.090684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c03de5f5-e8de-49b8-9cc6-f7c98fa7bc14 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:20.091874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c03de5f5-e8de-49b8-9cc6-f7c98fa7bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:20.146153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:20.162536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1025/2051] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:20.170389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817626da-06e9-41f2-b062-96ccea4aec24 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:20.170656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817626da-06e9-41f2-b062-96ccea4aec24 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:20.171159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817626da-06e9-41f2-b062-96ccea4aec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:20.192140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-817626da-06e9-41f2-b062-96ccea4aec24 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:20.193390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-817626da-06e9-41f2-b062-96ccea4aec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:20.201254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1027/2052] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:20.205715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03de5f5-e8de-49b8-9cc6-f7c98fa7bc14 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:20.215603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03de5f5-e8de-49b8-9cc6-f7c98fa7bc14 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:20.221237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ef5b5-f84e-4603-b338-eda0fd79d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:20.221833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ef5b5-f84e-4603-b338-eda0fd79d68e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:20.222138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ef5b5-f84e-4603-b338-eda0fd79d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:20.222415 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ef5b5-f84e-4603-b338-eda0fd79d68e admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:20.223317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ef5b5-f84e-4603-b338-eda0fd79d68e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:30:20.223615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ef5b5-f84e-4603-b338-eda0fd79d68e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:20.225211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ef5b5-f84e-4603-b338-eda0fd79d68e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:20.238295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1026/2053] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:30:20.242403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817626da-06e9-41f2-b062-96ccea4aec24 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:20.251070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:20.255508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817626da-06e9-41f2-b062-96ccea4aec24 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:20.272158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8ae79-34e2-4b1e-9829-ad80817b326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:20.273081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ae79-34e2-4b1e-9829-ad80817b326d admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:20.273540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ae79-34e2-4b1e-9829-ad80817b326d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:20.273963 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ae79-34e2-4b1e-9829-ad80817b326d admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:20.274970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8ae79-34e2-4b1e-9829-ad80817b326d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:20.277913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8ae79-34e2-4b1e-9829-ad80817b326d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:20.309510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1028/2054] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:30:20 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:30:20.313875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ef5b5-f84e-4603-b338-eda0fd79d68e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:20.324128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ef5b5-f84e-4603-b338-eda0fd79d68e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:20.383138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f0f7b-4c6b-4118-8b60-b8c1d0902837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:20.383745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f0f7b-4c6b-4118-8b60-b8c1d0902837 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:20.384020 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f0f7b-4c6b-4118-8b60-b8c1d0902837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:20.384310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f0f7b-4c6b-4118-8b60-b8c1d0902837 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:20.384920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f0f7b-4c6b-4118-8b60-b8c1d0902837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:20.386861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f0f7b-4c6b-4118-8b60-b8c1d0902837 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:20.408430 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1027/2055] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:30:20 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:30:20.412561 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8ae79-34e2-4b1e-9829-ad80817b326d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:20.422964 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8ae79-34e2-4b1e-9829-ad80817b326d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:20.427512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea2983-f6c9-43c8-9122-f1381936abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:20.428089 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea2983-f6c9-43c8-9122-f1381936abae admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:20.428361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea2983-f6c9-43c8-9122-f1381936abae admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:20.428626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea2983-f6c9-43c8-9122-f1381936abae admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:20.429281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea2983-f6c9-43c8-9122-f1381936abae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:20.430909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea2983-f6c9-43c8-9122-f1381936abae admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:20.440618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1029/2056] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:30:20.444362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f0f7b-4c6b-4118-8b60-b8c1d0902837 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:20.455692 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f0f7b-4c6b-4118-8b60-b8c1d0902837 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:20.460925 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997bbd5-8f2a-4233-8cee-14bf337b245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:20.461562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bbd5-8f2a-4233-8cee-14bf337b245e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:20.461881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bbd5-8f2a-4233-8cee-14bf337b245e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:20.462176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bbd5-8f2a-4233-8cee-14bf337b245e admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:20.462789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997bbd5-8f2a-4233-8cee-14bf337b245e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:20.464504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997bbd5-8f2a-4233-8cee-14bf337b245e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:20.478920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1028/2057] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:30:20.483684 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea2983-f6c9-43c8-9122-f1381936abae admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:20.495412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea2983-f6c9-43c8-9122-f1381936abae admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:20.500066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d157a-78c3-42ef-a52d-f2413dbde3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:20.500743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d157a-78c3-42ef-a52d-f2413dbde3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:20.501029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d157a-78c3-42ef-a52d-f2413dbde3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:20.501322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d157a-78c3-42ef-a52d-f2413dbde3f8 admin admin] PATH_INFO: `/v3/projects/c543cd83d7094255860122c2bab23887/users/128c2b557df24a5b8b4595f4c28d9de7/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:20.515776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d157a-78c3-42ef-a52d-f2413dbde3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c543cd83d7094255860122c2bab23887, user_id=128c2b557df24a5b8b4595f4c28d9de7, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:20.518987 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d157a-78c3-42ef-a52d-f2413dbde3f8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:20.532222 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1030/2058] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:30:20 2022] PUT /identity/v3/projects/c543cd83d7094255860122c2bab23887/users/128c2b557df24a5b8b4595f4c28d9de7/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:30:20.543497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751df5-a647-4164-b555-902505fe32fe None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:20.543807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751df5-a647-4164-b555-902505fe32fe None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:20.544111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751df5-a647-4164-b555-902505fe32fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:20.573500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4a751df5-a647-4164-b555-902505fe32fe None None] MFA Rules not processed for user `128c2b557df24a5b8b4595f4c28d9de7`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:20.574694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4a751df5-a647-4164-b555-902505fe32fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:20.638254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1029/2059] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:30:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:20.650681 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d157a-78c3-42ef-a52d-f2413dbde3f8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:20.652356 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6b4d157a-78c3-42ef-a52d-f2413dbde3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:20.709760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d157a-78c3-42ef-a52d-f2413dbde3f8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:20.713338 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf618d-6194-475a-8d0b-666d4ca0eb7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27a93c04181493593a069650a977773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:20.713925 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf618d-6194-475a-8d0b-666d4ca0eb7f service glance] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:20.714194 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf618d-6194-475a-8d0b-666d4ca0eb7f service glance] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:20.714465 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf618d-6194-475a-8d0b-666d4ca0eb7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:20.723922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf618d-6194-475a-8d0b-666d4ca0eb7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:20.725503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf618d-6194-475a-8d0b-666d4ca0eb7f service glance] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:20.734200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1031/2060] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:30:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:30:23.707411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302dec-1955-4256-b531-56accba4aefc None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:23.707955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302dec-1955-4256-b531-56accba4aefc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:23.707955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302dec-1955-4256-b531-56accba4aefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:23.730369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-82302dec-1955-4256-b531-56accba4aefc None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:23.731710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-82302dec-1955-4256-b531-56accba4aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:23.799288 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:23.827899 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1030/2061] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:23.855177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf618d-6194-475a-8d0b-666d4ca0eb7f service glance] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:23.856611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-acbf618d-6194-475a-8d0b-666d4ca0eb7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:23.961256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf618d-6194-475a-8d0b-666d4ca0eb7f service glance] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:23.965786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b215ba0-9f30-41bd-9f73-55ea753a8ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:23.966458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215ba0-9f30-41bd-9f73-55ea753a8ce8 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:23.966847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215ba0-9f30-41bd-9f73-55ea753a8ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:23.967086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215ba0-9f30-41bd-9f73-55ea753a8ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:23.976728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b215ba0-9f30-41bd-9f73-55ea753a8ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:23.978353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b215ba0-9f30-41bd-9f73-55ea753a8ce8 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:23.988676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1032/2062] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:30:27.794825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3411a-7fde-47f5-b11e-89abe4233ea3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:27.795292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3411a-7fde-47f5-b11e-89abe4233ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:27.795396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3411a-7fde-47f5-b11e-89abe4233ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:27.817758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-adf3411a-7fde-47f5-b11e-89abe4233ea3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:27.820379 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-adf3411a-7fde-47f5-b11e-89abe4233ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:27.830479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1031/2063] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:27.848719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b215ba0-9f30-41bd-9f73-55ea753a8ce8 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:27.866685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b215ba0-9f30-41bd-9f73-55ea753a8ce8 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:27.874316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b006cfc-2658-40a0-806d-5af52a3329dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:27.874935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b006cfc-2658-40a0-806d-5af52a3329dc service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:27.875218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b006cfc-2658-40a0-806d-5af52a3329dc service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:27.875490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b006cfc-2658-40a0-806d-5af52a3329dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:27.885394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b006cfc-2658-40a0-806d-5af52a3329dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:27.886976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b006cfc-2658-40a0-806d-5af52a3329dc service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:27.898686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1033/2064] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:30:30.974222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4b823-9cbc-48c9-a1d6-f1712ac73727 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:30.974730 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4b823-9cbc-48c9-a1d6-f1712ac73727 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:30.974875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4b823-9cbc-48c9-a1d6-f1712ac73727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:30.995176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-32a4b823-9cbc-48c9-a1d6-f1712ac73727 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:30.996290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-32a4b823-9cbc-48c9-a1d6-f1712ac73727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:31.004714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1032/2065] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:31.025585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b006cfc-2658-40a0-806d-5af52a3329dc service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:31.037663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b006cfc-2658-40a0-806d-5af52a3329dc service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:31.043473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ab846-067e-4a57-a3ad-718b32c9eb5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:31.044074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab846-067e-4a57-a3ad-718b32c9eb5b service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:31.044353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab846-067e-4a57-a3ad-718b32c9eb5b service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:31.044623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ab846-067e-4a57-a3ad-718b32c9eb5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:31.053057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ab846-067e-4a57-a3ad-718b32c9eb5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:31.054630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ab846-067e-4a57-a3ad-718b32c9eb5b service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:31.065321 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1034/2066] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:30:32.631868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c62a73-00b8-4065-91c2-faf8947ae8a6 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:32.632322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c62a73-00b8-4065-91c2-faf8947ae8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:32.632412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c62a73-00b8-4065-91c2-faf8947ae8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:32.654191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d7c62a73-00b8-4065-91c2-faf8947ae8a6 None None] MFA Rules not processed for user `78bec0414d064ed8901271fc4c57cfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:32.655740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d7c62a73-00b8-4065-91c2-faf8947ae8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:32.714459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1033/2067] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:30:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:34.171480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6334d-8038-4a05-aa60-03d3cf61431f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:34.172036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6334d-8038-4a05-aa60-03d3cf61431f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:34.172302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6334d-8038-4a05-aa60-03d3cf61431f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:34.192531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b5c6334d-8038-4a05-aa60-03d3cf61431f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:34.193839 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b5c6334d-8038-4a05-aa60-03d3cf61431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:34.201874 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1035/2068] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Nov 2 07:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:34.219665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c62a73-00b8-4065-91c2-faf8947ae8a6 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:34.232646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c62a73-00b8-4065-91c2-faf8947ae8a6 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:34.238791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc517943-bc8b-4bff-8dd8-f0712203065b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:34.239491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517943-bc8b-4bff-8dd8-f0712203065b service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:34.239774 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517943-bc8b-4bff-8dd8-f0712203065b service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:34.240050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517943-bc8b-4bff-8dd8-f0712203065b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:34.248053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc517943-bc8b-4bff-8dd8-f0712203065b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:34.249663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc517943-bc8b-4bff-8dd8-f0712203065b service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:34.259990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1034/2069] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:30:44.186605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:44.255972 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=42 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:48.104973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6334d-8038-4a05-aa60-03d3cf61431f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:48.115503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6334d-8038-4a05-aa60-03d3cf61431f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:48.120034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:48.120668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:48.120949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:48.121256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] PATH_INFO: `/v3/users/128c2b557df24a5b8b4595f4c28d9de7` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:48.122363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] RBAC: Authorizing `identity:delete_user(user_id=128c2b557df24a5b8b4595f4c28d9de7)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:48.124253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:48.176715 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '128c2b557df24a5b8b4595f4c28d9de7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:48.177655 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '128c2b557df24a5b8b4595f4c28d9de7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:48.185115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '128c2b557df24a5b8b4595f4c28d9de7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:48.186021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '128c2b557df24a5b8b4595f4c28d9de7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:48.202542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '128c2b557df24a5b8b4595f4c28d9de7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:48.227503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1036/2070] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:30:48 2022] DELETE /identity/v3/users/128c2b557df24a5b8b4595f4c28d9de7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:30:48.232581 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69b316-ab2c-4ffd-82a0-6c04589d6f12 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:48.232984 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69b316-ab2c-4ffd-82a0-6c04589d6f12 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:48.233144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69b316-ab2c-4ffd-82a0-6c04589d6f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:48.253628 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-8b69b316-ab2c-4ffd-82a0-6c04589d6f12 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:48.254830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8b69b316-ab2c-4ffd-82a0-6c04589d6f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:48.316798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1035/2071] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:48.326555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:48.328100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:48.387323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecfdaf-bfe8-4f94-89b2-16da4f72055b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:48.390961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219e81a-da0a-4e1b-a75a-a2ecc99c7811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:48.391557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219e81a-da0a-4e1b-a75a-a2ecc99c7811 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:48.391828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219e81a-da0a-4e1b-a75a-a2ecc99c7811 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:48.392094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219e81a-da0a-4e1b-a75a-a2ecc99c7811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:48.402027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219e81a-da0a-4e1b-a75a-a2ecc99c7811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:48.403429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219e81a-da0a-4e1b-a75a-a2ecc99c7811 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:48.413341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1037/2072] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:30:48.748367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69b316-ab2c-4ffd-82a0-6c04589d6f12 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:48.749861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8b69b316-ab2c-4ffd-82a0-6c04589d6f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:48.763033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69b316-ab2c-4ffd-82a0-6c04589d6f12 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:48.769676 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:48.770645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:48.771027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:48.771568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] PATH_INFO: `/v3/projects/c543cd83d7094255860122c2bab23887` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:48.773260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c543cd83d7094255860122c2bab23887)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:48.775712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:48.830848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c543cd83d7094255860122c2bab23887', 'request_id': 'req-ee139627-b053-4706-af5b-cf778f4342a6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:48.844101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c543cd83d7094255860122c2bab23887', 'request_id': 'req-ee139627-b053-4706-af5b-cf778f4342a6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:48.853705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c543cd83d7094255860122c2bab23887', 'request_id': 'req-ee139627-b053-4706-af5b-cf778f4342a6'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:48.868701 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] The token cache is being invalidate because project c543cd83d7094255860122c2bab23887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:30:48.868993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:48.869705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ee139627-b053-4706-af5b-cf778f4342a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:30:48.871272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1036/2073] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:30:48 2022] DELETE /identity/v3/projects/c543cd83d7094255860122c2bab23887 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:30:48.876370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2c5f-761b-42ed-8f36-88da2528bfc8 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:48.876731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2c5f-761b-42ed-8f36-88da2528bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:48.877692 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2c5f-761b-42ed-8f36-88da2528bfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:48.898417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-863b2c5f-761b-42ed-8f36-88da2528bfc8 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:48.899812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-863b2c5f-761b-42ed-8f36-88da2528bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:48.974521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1038/2074] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:48.975079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e7501-b190-48e7-9e10-388ec5bde0b0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:48.975215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e7501-b190-48e7-9e10-388ec5bde0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:48.975480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e7501-b190-48e7-9e10-388ec5bde0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:48.997358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-364e7501-b190-48e7-9e10-388ec5bde0b0 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:48.998567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-364e7501-b190-48e7-9e10-388ec5bde0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:49.012915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1037/2075] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:49.015916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b2c5f-761b-42ed-8f36-88da2528bfc8 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:49.027942 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b2c5f-761b-42ed-8f36-88da2528bfc8 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:49.034476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aabf6-778a-4441-b3fd-958242c1f33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:49.035223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aabf6-778a-4441-b3fd-958242c1f33f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:49.035978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aabf6-778a-4441-b3fd-958242c1f33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:49.035978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aabf6-778a-4441-b3fd-958242c1f33f admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:49.036450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aabf6-778a-4441-b3fd-958242c1f33f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:30:49.036753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aabf6-778a-4441-b3fd-958242c1f33f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:49.038664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aabf6-778a-4441-b3fd-958242c1f33f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:49.057802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1039/2076] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:30:49.070262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e7501-b190-48e7-9e10-388ec5bde0b0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:49.080405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e7501-b190-48e7-9e10-388ec5bde0b0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:49.086025 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aa110-d0f8-4b3c-9d5b-bafd80d52e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:49.086759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aa110-d0f8-4b3c-9d5b-bafd80d52e40 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:49.087132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aa110-d0f8-4b3c-9d5b-bafd80d52e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:49.087508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aa110-d0f8-4b3c-9d5b-bafd80d52e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:49.088398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9aa110-d0f8-4b3c-9d5b-bafd80d52e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:49.090823 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9aa110-d0f8-4b3c-9d5b-bafd80d52e40 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:49.134818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1038/2077] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:30:49 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:30:49.136069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aabf6-778a-4441-b3fd-958242c1f33f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:49.141421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:49.151035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aabf6-778a-4441-b3fd-958242c1f33f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:49.233794 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f6824-bb9a-4d38-adc7-8d49c44777f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:49.234398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f6824-bb9a-4d38-adc7-8d49c44777f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:49.234671 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f6824-bb9a-4d38-adc7-8d49c44777f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:49.234934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f6824-bb9a-4d38-adc7-8d49c44777f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:49.235555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f6824-bb9a-4d38-adc7-8d49c44777f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:49.238154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f6824-bb9a-4d38-adc7-8d49c44777f8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:49.263140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1040/2078] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:30:49 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:30:49.264429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aa110-d0f8-4b3c-9d5b-bafd80d52e40 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:49.285330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aa110-d0f8-4b3c-9d5b-bafd80d52e40 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:49.290818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbcf32-86c2-4f7f-8ac0-c735576f432e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:49.291429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbcf32-86c2-4f7f-8ac0-c735576f432e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:49.291706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbcf32-86c2-4f7f-8ac0-c735576f432e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:49.291975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbcf32-86c2-4f7f-8ac0-c735576f432e admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:49.292619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbcf32-86c2-4f7f-8ac0-c735576f432e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:49.294254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbcf32-86c2-4f7f-8ac0-c735576f432e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:49.316545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1039/2079] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:30:49.320773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f6824-bb9a-4d38-adc7-8d49c44777f8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:49.332661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f6824-bb9a-4d38-adc7-8d49c44777f8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:49.338493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a368e-4cae-4efb-b417-6e665700b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:49.339011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a368e-4cae-4efb-b417-6e665700b574 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:49.339353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a368e-4cae-4efb-b417-6e665700b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:49.339685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a368e-4cae-4efb-b417-6e665700b574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:49.340482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a368e-4cae-4efb-b417-6e665700b574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:49.342279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a368e-4cae-4efb-b417-6e665700b574 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:49.354084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1041/2080] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:30:49.358223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbcf32-86c2-4f7f-8ac0-c735576f432e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:49.373246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbcf32-86c2-4f7f-8ac0-c735576f432e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:49.379516 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdacea-8b5d-4831-838e-ec514a17109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:49.380195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdacea-8b5d-4831-838e-ec514a17109c admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:49.380467 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdacea-8b5d-4831-838e-ec514a17109c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:49.381513 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdacea-8b5d-4831-838e-ec514a17109c admin admin] PATH_INFO: `/v3/projects/f757b7ef18fe4357a44533d15d226f98/users/48ea8c2a7f3b4a3395de0ffa4ec96648/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:49.401440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdacea-8b5d-4831-838e-ec514a17109c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f757b7ef18fe4357a44533d15d226f98, user_id=48ea8c2a7f3b4a3395de0ffa4ec96648, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:49.404167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdacea-8b5d-4831-838e-ec514a17109c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:49.420004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1040/2081] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:30:49 2022] PUT /identity/v3/projects/f757b7ef18fe4357a44533d15d226f98/users/48ea8c2a7f3b4a3395de0ffa4ec96648/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:30:49.431423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ffab8-da42-465c-a382-c9a150e61678 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:49.431696 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ffab8-da42-465c-a382-c9a150e61678 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:49.432286 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ffab8-da42-465c-a382-c9a150e61678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:49.486024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5c7ffab8-da42-465c-a382-c9a150e61678 None None] MFA Rules not processed for user `48ea8c2a7f3b4a3395de0ffa4ec96648`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:30:49.488338 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5c7ffab8-da42-465c-a382-c9a150e61678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:49.582661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1042/2082] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:30:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:30:49.602355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdacea-8b5d-4831-838e-ec514a17109c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:30:49.604309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-68bdacea-8b5d-4831-838e-ec514a17109c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:30:49.638789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:49.697372 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdacea-8b5d-4831-838e-ec514a17109c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:30:49.701149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aea53e-f3ad-41fb-844e-22c9396a7873 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27a93c04181493593a069650a977773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:30:49.701920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea53e-f3ad-41fb-844e-22c9396a7873 service glance] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:30:49.702082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea53e-f3ad-41fb-844e-22c9396a7873 service glance] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:30:49.702339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea53e-f3ad-41fb-844e-22c9396a7873 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:30:49.718515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aea53e-f3ad-41fb-844e-22c9396a7873 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:30:49.720089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aea53e-f3ad-41fb-844e-22c9396a7873 service glance] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:30:49.730480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1041/2083] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:30:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:30:59.577694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:59.729474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=17 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:07.585645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ffab8-da42-465c-a382-c9a150e61678 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:31:07.585645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5c7ffab8-da42-465c-a382-c9a150e61678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:07.650581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ffab8-da42-465c-a382-c9a150e61678 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:31:07.655429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:31:07.656174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:07.656502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:07.656780 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] PATH_INFO: `/v3/users/977979e33b244cf8aceff6eddc8653b4` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:07.658072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=977979e33b244cf8aceff6eddc8653b4)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:31:07.660251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:31:07.707470 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977979e33b244cf8aceff6eddc8653b4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:07.708180 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977979e33b244cf8aceff6eddc8653b4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:07.715103 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977979e33b244cf8aceff6eddc8653b4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:07.715733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977979e33b244cf8aceff6eddc8653b4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:07.727715 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977979e33b244cf8aceff6eddc8653b4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:07.741035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1043/2084] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:31:07 2022] DELETE /identity/v3/users/977979e33b244cf8aceff6eddc8653b4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:31:07.915815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aea53e-f3ad-41fb-844e-22c9396a7873 service glance] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:31:07.927458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aea53e-f3ad-41fb-844e-22c9396a7873 service glance] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:31:07.992792 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:31:07.993372 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:07.993648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:07.993914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] PATH_INFO: `/v3/projects/e6f904d22d4244988c509875e4a7bc73` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:07.995023 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f904d22d4244988c509875e4a7bc73)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:31:07.996918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:31:08.042605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f904d22d4244988c509875e4a7bc73', 'request_id': 'req-01845d20-3eed-4bc6-bfb1-39a7d03925ec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:08.049163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f904d22d4244988c509875e4a7bc73', 'request_id': 'req-01845d20-3eed-4bc6-bfb1-39a7d03925ec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:08.055334 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f904d22d4244988c509875e4a7bc73', 'request_id': 'req-01845d20-3eed-4bc6-bfb1-39a7d03925ec'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:08.066596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] The token cache is being invalidate because project e6f904d22d4244988c509875e4a7bc73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:31:08.066884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:08.067530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-01845d20-3eed-4bc6-bfb1-39a7d03925ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:08.069000 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1042/2085] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:31:07 2022] DELETE /identity/v3/projects/e6f904d22d4244988c509875e4a7bc73 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:31:15.609603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:31:15.611050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:15.624173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d93e6-1659-4a19-ad3b-7fed7e8368aa admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:31:15.680679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:31:15.681327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:15.681603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:15.681870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] PATH_INFO: `/v3/users/48ea8c2a7f3b4a3395de0ffa4ec96648` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:15.682976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ea8c2a7f3b4a3395de0ffa4ec96648)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:31:15.684864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:31:15.706778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:15.731114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ea8c2a7f3b4a3395de0ffa4ec96648'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:15.731753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ea8c2a7f3b4a3395de0ffa4ec96648'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:15.738969 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ea8c2a7f3b4a3395de0ffa4ec96648'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:15.739605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ea8c2a7f3b4a3395de0ffa4ec96648'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:15.751839 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ea8c2a7f3b4a3395de0ffa4ec96648'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:15.765372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1044/2086] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:31:15 2022] DELETE /identity/v3/users/48ea8c2a7f3b4a3395de0ffa4ec96648 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:31:15.770374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78853b9-57f1-45f6-8dd8-15f49e60f903 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:15.770872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78853b9-57f1-45f6-8dd8-15f49e60f903 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:15.771035 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78853b9-57f1-45f6-8dd8-15f49e60f903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:15.790405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-d78853b9-57f1-45f6-8dd8-15f49e60f903 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:31:15.791608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d78853b9-57f1-45f6-8dd8-15f49e60f903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:15.850402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1043/2087] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:31:15.860257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:31:15.861676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:15.920232 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067abd-3954-4d08-8466-12a01f1f97a7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:31:15.924023 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643996ff-6e05-40fa-889e-141b05911c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:31:15.924652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643996ff-6e05-40fa-889e-141b05911c73 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:15.924930 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643996ff-6e05-40fa-889e-141b05911c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:15.925415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643996ff-6e05-40fa-889e-141b05911c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:15.934473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643996ff-6e05-40fa-889e-141b05911c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:31:15.935885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643996ff-6e05-40fa-889e-141b05911c73 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:31:15.945600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1045/2088] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:31:16.213319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78853b9-57f1-45f6-8dd8-15f49e60f903 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:31:16.214741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d78853b9-57f1-45f6-8dd8-15f49e60f903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:16.226712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78853b9-57f1-45f6-8dd8-15f49e60f903 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:31:16.231411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:31:16.232026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:16.232302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:16.232567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] PATH_INFO: `/v3/projects/f757b7ef18fe4357a44533d15d226f98` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:16.233920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f757b7ef18fe4357a44533d15d226f98)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:31:16.235826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:31:16.267590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:16.287093 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f757b7ef18fe4357a44533d15d226f98', 'request_id': 'req-aa2b4be9-4633-41bb-98a7-c52adb2f3630'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:16.294822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f757b7ef18fe4357a44533d15d226f98', 'request_id': 'req-aa2b4be9-4633-41bb-98a7-c52adb2f3630'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:16.300547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f757b7ef18fe4357a44533d15d226f98', 'request_id': 'req-aa2b4be9-4633-41bb-98a7-c52adb2f3630'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:16.312064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] The token cache is being invalidate because project f757b7ef18fe4357a44533d15d226f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:31:16.312483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:16.313530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-aa2b4be9-4633-41bb-98a7-c52adb2f3630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:31:16.314661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1044/2089] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:31:16 2022] DELETE /identity/v3/projects/f757b7ef18fe4357a44533d15d226f98 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:31:24.854937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60da9e-4687-422b-9ca0-c689f771a81a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:24.855521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60da9e-4687-422b-9ca0-c689f771a81a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:24.855632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60da9e-4687-422b-9ca0-c689f771a81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:24.876814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1f60da9e-4687-422b-9ca0-c689f771a81a None None] MFA Rules not processed for user `4eba12ea4c4245099fea1e3be288c683`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:31:24.878788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1f60da9e-4687-422b-9ca0-c689f771a81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:24.937365 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1046/2090] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:31:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:31:26.259812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d207e-0d9a-4b8c-b3f3-c829e5955592 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:26.260358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d207e-0d9a-4b8c-b3f3-c829e5955592 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:26.260358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d207e-0d9a-4b8c-b3f3-c829e5955592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:26.280278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-158d207e-0d9a-4b8c-b3f3-c829e5955592 None None] MFA Rules not processed for user `eb19406216904864b983404a0ce65e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:31:26.281528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-158d207e-0d9a-4b8c-b3f3-c829e5955592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:26.338943 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1045/2091] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:31:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:31:34.930754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=7,keystone:SELECT=71,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:36.332566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=6,keystone:SELECT=39,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:46.965743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30bd75-fe5b-4c01-8c7c-b7d546f0db47 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:46.966236 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30bd75-fe5b-4c01-8c7c-b7d546f0db47 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:46.966351 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30bd75-fe5b-4c01-8c7c-b7d546f0db47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:46.986830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7e30bd75-fe5b-4c01-8c7c-b7d546f0db47 None None] MFA Rules not processed for user `78bec0414d064ed8901271fc4c57cfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:31:46.988026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7e30bd75-fe5b-4c01-8c7c-b7d546f0db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:47.041341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1047/2092] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:31:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:31:52.330640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d207e-0d9a-4b8c-b3f3-c829e5955592 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:31:52.332083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-158d207e-0d9a-4b8c-b3f3-c829e5955592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:52.390444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d207e-0d9a-4b8c-b3f3-c829e5955592 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:31:52.394742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763225f6-3cb0-4ff6-a7ed-3186ca86c550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:31:52.395332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763225f6-3cb0-4ff6-a7ed-3186ca86c550 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:52.395604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763225f6-3cb0-4ff6-a7ed-3186ca86c550 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:52.395869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763225f6-3cb0-4ff6-a7ed-3186ca86c550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:52.397592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-763225f6-3cb0-4ff6-a7ed-3186ca86c550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:52.465600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763225f6-3cb0-4ff6-a7ed-3186ca86c550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:31:52.467032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763225f6-3cb0-4ff6-a7ed-3186ca86c550 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:31:52.478018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1046/2093] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:31:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:31:52.787697 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30bd75-fe5b-4c01-8c7c-b7d546f0db47 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:31:52.789146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7e30bd75-fe5b-4c01-8c7c-b7d546f0db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:52.801808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30bd75-fe5b-4c01-8c7c-b7d546f0db47 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:31:52.806469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417097-d6f2-4a0f-8125-fbe1981f2909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:31:52.807151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417097-d6f2-4a0f-8125-fbe1981f2909 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:31:52.807425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417097-d6f2-4a0f-8125-fbe1981f2909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:31:52.807720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417097-d6f2-4a0f-8125-fbe1981f2909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:31:52.809495 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-56417097-d6f2-4a0f-8125-fbe1981f2909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:31:52.824770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56417097-d6f2-4a0f-8125-fbe1981f2909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:31:52.826539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56417097-d6f2-4a0f-8125-fbe1981f2909 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:31:52.840005 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1048/2094] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:31:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:01.800004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400d762-594e-4e78-b92e-39121dd589dc None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:01.800497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400d762-594e-4e78-b92e-39121dd589dc None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:01.800597 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400d762-594e-4e78-b92e-39121dd589dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:01.821603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5400d762-594e-4e78-b92e-39121dd589dc None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:01.822811 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5400d762-594e-4e78-b92e-39121dd589dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:01.879088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1047/2095] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 07:32:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:01.929310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417097-d6f2-4a0f-8125-fbe1981f2909 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:01.930793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-56417097-d6f2-4a0f-8125-fbe1981f2909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:02.002962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417097-d6f2-4a0f-8125-fbe1981f2909 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:02.008254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b35462-6f8b-4b5c-a465-2108918874a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:02.008856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35462-6f8b-4b5c-a465-2108918874a9 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:02.009170 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35462-6f8b-4b5c-a465-2108918874a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:02.009440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35462-6f8b-4b5c-a465-2108918874a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:02.018254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b35462-6f8b-4b5c-a465-2108918874a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:02.019767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b35462-6f8b-4b5c-a465-2108918874a9 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:02.028099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1049/2096] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:32:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:32:05.762003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35438f0e-a531-47ba-abe8-3c9bfd23d34d None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:05.762837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35438f0e-a531-47ba-abe8-3c9bfd23d34d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:05.763271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35438f0e-a531-47ba-abe8-3c9bfd23d34d None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:05.764650 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1048/2097] 10.222.0.13 () {54 vars in 961 bytes} [Wed Nov 2 07:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:05.770883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a2369-5763-49fc-aa1f-c58a26cacd27 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:05.771898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a2369-5763-49fc-aa1f-c58a26cacd27 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:05.772410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a2369-5763-49fc-aa1f-c58a26cacd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:05.794861 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-040a2369-5763-49fc-aa1f-c58a26cacd27 None None] MFA Rules not processed for user `55214b594a3f42ff8a7e0cecdef98937`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:05.796325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-040a2369-5763-49fc-aa1f-c58a26cacd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:05.874006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1050/2098] 10.222.0.13 () {58 vars in 1058 bytes} [Wed Nov 2 07:32:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:05.881805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35438f0e-a531-47ba-abe8-3c9bfd23d34d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:05.902105 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35438f0e-a531-47ba-abe8-3c9bfd23d34d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:05.908959 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2be92-29cd-4850-aadc-89838a2d0ede service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:05.909971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2be92-29cd-4850-aadc-89838a2d0ede service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:05.910245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2be92-29cd-4850-aadc-89838a2d0ede service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:05.910508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2be92-29cd-4850-aadc-89838a2d0ede service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:05.912394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1cc2be92-29cd-4850-aadc-89838a2d0ede service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:05.926636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2be92-29cd-4850-aadc-89838a2d0ede service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:05.928264 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2be92-29cd-4850-aadc-89838a2d0ede service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:05.938355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1049/2099] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:09.475542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a2369-5763-49fc-aa1f-c58a26cacd27 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:09.477346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-040a2369-5763-49fc-aa1f-c58a26cacd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:09.503785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=100 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:09.582899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a2369-5763-49fc-aa1f-c58a26cacd27 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:09.588975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:09.589820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:09.590220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:09.590595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] PATH_INFO: `/v3/users/15dc4bbe837f49c2b854bf4306ea8cfd` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:09.592076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15dc4bbe837f49c2b854bf4306ea8cfd)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:09.595745 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:09.666780 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15dc4bbe837f49c2b854bf4306ea8cfd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:09.667699 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15dc4bbe837f49c2b854bf4306ea8cfd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:09.677907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15dc4bbe837f49c2b854bf4306ea8cfd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:09.678679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15dc4bbe837f49c2b854bf4306ea8cfd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:09.694536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15dc4bbe837f49c2b854bf4306ea8cfd'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:09.713994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1051/2100] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:32:09 2022] DELETE /identity/v3/users/15dc4bbe837f49c2b854bf4306ea8cfd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:09.904680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2be92-29cd-4850-aadc-89838a2d0ede service placement] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:09.938591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2be92-29cd-4850-aadc-89838a2d0ede service placement] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:09.969278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:09.996695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:09.997348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:09.997624 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:09.997894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] PATH_INFO: `/v3/projects/ac70f7a12b4748be9c89ed804eadd1f8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:09.999019 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac70f7a12b4748be9c89ed804eadd1f8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:10.000998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:10.048106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac70f7a12b4748be9c89ed804eadd1f8', 'request_id': 'req-0dc5ae2d-af48-4a51-b72d-35755dd63309'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.056510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac70f7a12b4748be9c89ed804eadd1f8', 'request_id': 'req-0dc5ae2d-af48-4a51-b72d-35755dd63309'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.065417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac70f7a12b4748be9c89ed804eadd1f8', 'request_id': 'req-0dc5ae2d-af48-4a51-b72d-35755dd63309'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.077560 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] The token cache is being invalidate because project ac70f7a12b4748be9c89ed804eadd1f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:32:10.077846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.078531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.080694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1050/2101] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:32:09 2022] DELETE /identity/v3/projects/ac70f7a12b4748be9c89ed804eadd1f8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:10.084860 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:10.086508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:10.102798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cd60a-7386-4c2f-a04c-f97f56e4453e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:10.169351 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:10.169977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:10.170496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:10.170496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] PATH_INFO: `/v3/users/6cb6e027ba724703929399d707142d1e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:10.171790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cb6e027ba724703929399d707142d1e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:10.174741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:10.228007 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:10.235527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cb6e027ba724703929399d707142d1e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.236489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cb6e027ba724703929399d707142d1e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.246695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cb6e027ba724703929399d707142d1e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.247504 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cb6e027ba724703929399d707142d1e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.262685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cb6e027ba724703929399d707142d1e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.280833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1052/2102] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:32:10 2022] DELETE /identity/v3/users/6cb6e027ba724703929399d707142d1e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:10.483793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:10.485300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:10.501791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5ae2d-af48-4a51-b72d-35755dd63309 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:10.561404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:10.562139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:10.562416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:10.562688 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] PATH_INFO: `/v3/projects/2a2e7b489c7043d5ad66cf461d3f9753` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:10.563856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2e7b489c7043d5ad66cf461d3f9753)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:10.565807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:10.614335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2e7b489c7043d5ad66cf461d3f9753', 'request_id': 'req-3322e763-a758-4c24-bfd1-7295a6e77b33'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.622028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2e7b489c7043d5ad66cf461d3f9753', 'request_id': 'req-3322e763-a758-4c24-bfd1-7295a6e77b33'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.627873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2e7b489c7043d5ad66cf461d3f9753', 'request_id': 'req-3322e763-a758-4c24-bfd1-7295a6e77b33'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.629094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:10.641573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] The token cache is being invalidate because project 2a2e7b489c7043d5ad66cf461d3f9753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:32:10.642469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.643167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:10.644721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1051/2103] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:32:10 2022] DELETE /identity/v3/projects/2a2e7b489c7043d5ad66cf461d3f9753 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:11.556463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:11.557893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:11.615650 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98b24c-cef1-4151-8de1-6f7757e77518 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:11.663409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09731c66-57ed-4b87-8d1d-7b6fce73e198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:11.664012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09731c66-57ed-4b87-8d1d-7b6fce73e198 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:11.664311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09731c66-57ed-4b87-8d1d-7b6fce73e198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:11.664584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09731c66-57ed-4b87-8d1d-7b6fce73e198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:11.666333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-09731c66-57ed-4b87-8d1d-7b6fce73e198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:11.723891 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09731c66-57ed-4b87-8d1d-7b6fce73e198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:11.725350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09731c66-57ed-4b87-8d1d-7b6fce73e198 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:11.734304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1053/2104] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:20.639997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:21.730058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=5,keystone:SELECT=82,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:24.093111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:24.094502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:24.106835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322e763-a758-4c24-bfd1-7295a6e77b33 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:24.110876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b40f21-70c6-4460-b722-4befdfe8a48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:24.111470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b40f21-70c6-4460-b722-4befdfe8a48f service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:24.111740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b40f21-70c6-4460-b722-4befdfe8a48f service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:24.111999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b40f21-70c6-4460-b722-4befdfe8a48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:24.112140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09731c66-57ed-4b87-8d1d-7b6fce73e198 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:24.113450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-09731c66-57ed-4b87-8d1d-7b6fce73e198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:24.113725 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-14b40f21-70c6-4460-b722-4befdfe8a48f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:24.177586 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b40f21-70c6-4460-b722-4befdfe8a48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:24.179158 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b40f21-70c6-4460-b722-4befdfe8a48f service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:24.187068 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09731c66-57ed-4b87-8d1d-7b6fce73e198 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:24.189683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1052/2105] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:24.197278 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490650-05cf-4133-9779-79dba311175b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:24.197899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490650-05cf-4133-9779-79dba311175b service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:24.198169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490650-05cf-4133-9779-79dba311175b service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:24.198432 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490650-05cf-4133-9779-79dba311175b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:24.200412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-04490650-05cf-4133-9779-79dba311175b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:24.259119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490650-05cf-4133-9779-79dba311175b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:24.260738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490650-05cf-4133-9779-79dba311175b service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:24.270481 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1054/2106] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:32:27.327269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b40f21-70c6-4460-b722-4befdfe8a48f service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:27.329590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-14b40f21-70c6-4460-b722-4befdfe8a48f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:27.344303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b40f21-70c6-4460-b722-4befdfe8a48f service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:27.349500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:27.350220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:27.350753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:27.351029 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] PATH_INFO: `/v3/users/4eba12ea4c4245099fea1e3be288c683` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:27.352143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eba12ea4c4245099fea1e3be288c683)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:27.354145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:27.404382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eba12ea4c4245099fea1e3be288c683'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:27.413160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eba12ea4c4245099fea1e3be288c683'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:27.413781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eba12ea4c4245099fea1e3be288c683'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:27.428184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eba12ea4c4245099fea1e3be288c683'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:27.435687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-a4ee7e61-2659-4489-a655-677e45d25e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eba12ea4c4245099fea1e3be288c683'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:27.442237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1053/2107] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:32:27 2022] DELETE /identity/v3/users/4eba12ea4c4245099fea1e3be288c683 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:27.623998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490650-05cf-4133-9779-79dba311175b service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:27.637433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490650-05cf-4133-9779-79dba311175b service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:27.715840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:27.716486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:27.716839 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:27.717057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] PATH_INFO: `/v3/projects/647ff1765a4547008f0906068818c949` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:27.718364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=647ff1765a4547008f0906068818c949)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:27.720766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:27.762169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:27.770347 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647ff1765a4547008f0906068818c949', 'request_id': 'req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:27.776111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647ff1765a4547008f0906068818c949', 'request_id': 'req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:27.782750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647ff1765a4547008f0906068818c949', 'request_id': 'req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:27.794941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] The token cache is being invalidate because project 647ff1765a4547008f0906068818c949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:32:27.795225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:27.795832 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-84d9f79b-ebfc-45ca-ad8b-6105a2a9f31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:27.797330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1055/2108] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:32:27 2022] DELETE /identity/v3/projects/647ff1765a4547008f0906068818c949 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:27.802895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29802-0665-42d2-ae72-75bc76ded451 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:27.803177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29802-0665-42d2-ae72-75bc76ded451 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:27.803443 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29802-0665-42d2-ae72-75bc76ded451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:27.822502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-14f29802-0665-42d2-ae72-75bc76ded451 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:27.823684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-14f29802-0665-42d2-ae72-75bc76ded451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:27.882997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1054/2109] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:27.890926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46316299-a5a7-44ac-b6db-73dbe54a9ba2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:27.891210 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46316299-a5a7-44ac-b6db-73dbe54a9ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:27.892055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46316299-a5a7-44ac-b6db-73dbe54a9ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:27.912946 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-46316299-a5a7-44ac-b6db-73dbe54a9ba2 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:27.914217 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-46316299-a5a7-44ac-b6db-73dbe54a9ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:27.922573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1056/2110] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:27.926876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29802-0665-42d2-ae72-75bc76ded451 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:27.937301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29802-0665-42d2-ae72-75bc76ded451 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:27.942111 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0b15-ecf1-42d7-bdb1-393a87b16a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:27.942767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0b15-ecf1-42d7-bdb1-393a87b16a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:27.943093 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0b15-ecf1-42d7-bdb1-393a87b16a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:27.943530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0b15-ecf1-42d7-bdb1-393a87b16a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:27.944201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b0b15-ecf1-42d7-bdb1-393a87b16a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:32:27.944658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b0b15-ecf1-42d7-bdb1-393a87b16a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:27.946494 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b0b15-ecf1-42d7-bdb1-393a87b16a59 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:27.948199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:27.961500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1055/2111] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:32:27.965661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46316299-a5a7-44ac-b6db-73dbe54a9ba2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:27.976308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46316299-a5a7-44ac-b6db-73dbe54a9ba2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:27.981085 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6963d-5927-4885-9556-6ad9c55e36f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:27.981679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6963d-5927-4885-9556-6ad9c55e36f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:27.981958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6963d-5927-4885-9556-6ad9c55e36f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:27.982259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6963d-5927-4885-9556-6ad9c55e36f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:27.982902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6963d-5927-4885-9556-6ad9c55e36f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:27.984827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6963d-5927-4885-9556-6ad9c55e36f1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:28.011795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1057/2112] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:32:27 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:32:28.015844 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0b15-ecf1-42d7-bdb1-393a87b16a59 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:28.026481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0b15-ecf1-42d7-bdb1-393a87b16a59 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:28.083241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a397d4-aaf9-432a-a1de-1df8b40a5a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:28.083834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a397d4-aaf9-432a-a1de-1df8b40a5a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:28.084150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a397d4-aaf9-432a-a1de-1df8b40a5a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:28.084388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a397d4-aaf9-432a-a1de-1df8b40a5a68 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:28.085051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a397d4-aaf9-432a-a1de-1df8b40a5a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:28.086967 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a397d4-aaf9-432a-a1de-1df8b40a5a68 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:28.107484 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1056/2113] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:32:28 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:32:28.112091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6963d-5927-4885-9556-6ad9c55e36f1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:28.122439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6963d-5927-4885-9556-6ad9c55e36f1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:28.127685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd90ae-5c36-4137-8fa5-12facf8acdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:28.128268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd90ae-5c36-4137-8fa5-12facf8acdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:28.128540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd90ae-5c36-4137-8fa5-12facf8acdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:28.128807 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd90ae-5c36-4137-8fa5-12facf8acdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:28.129470 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd90ae-5c36-4137-8fa5-12facf8acdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:28.131034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd90ae-5c36-4137-8fa5-12facf8acdf1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:28.143682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1058/2114] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:32:28.144961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a397d4-aaf9-432a-a1de-1df8b40a5a68 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:28.154768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a397d4-aaf9-432a-a1de-1df8b40a5a68 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:28.159851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6f7ff-6f1a-4327-83e9-0f535058f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:28.160435 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6f7ff-6f1a-4327-83e9-0f535058f521 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:28.160710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6f7ff-6f1a-4327-83e9-0f535058f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:28.160977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6f7ff-6f1a-4327-83e9-0f535058f521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:28.161639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6f7ff-6f1a-4327-83e9-0f535058f521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:28.163227 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6f7ff-6f1a-4327-83e9-0f535058f521 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:28.174741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1057/2115] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:32:28.178892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd90ae-5c36-4137-8fa5-12facf8acdf1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:28.189364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd90ae-5c36-4137-8fa5-12facf8acdf1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:28.193954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175a03-e002-4f76-8180-3db85d1932f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:28.194590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175a03-e002-4f76-8180-3db85d1932f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:28.194870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175a03-e002-4f76-8180-3db85d1932f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:28.195145 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175a03-e002-4f76-8180-3db85d1932f4 admin admin] PATH_INFO: `/v3/projects/0ec78dbcb3e746a48935acfe240cc4cf/users/41f160ae0e09481594bad75cb84e9a5b/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:28.210887 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175a03-e002-4f76-8180-3db85d1932f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec78dbcb3e746a48935acfe240cc4cf, user_id=41f160ae0e09481594bad75cb84e9a5b, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:28.213562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175a03-e002-4f76-8180-3db85d1932f4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:28.226969 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1059/2116] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:32:28 2022] PUT /identity/v3/projects/0ec78dbcb3e746a48935acfe240cc4cf/users/41f160ae0e09481594bad75cb84e9a5b/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:28.231979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b70875-ea4d-4bb3-8fae-c36b4a5fd450 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:28.232287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b70875-ea4d-4bb3-8fae-c36b4a5fd450 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:28.232585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b70875-ea4d-4bb3-8fae-c36b4a5fd450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:28.253572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-03b70875-ea4d-4bb3-8fae-c36b4a5fd450 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:28.254770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-03b70875-ea4d-4bb3-8fae-c36b4a5fd450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:28.312476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1058/2117] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:32:28.322934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175a03-e002-4f76-8180-3db85d1932f4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:28.324833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-27175a03-e002-4f76-8180-3db85d1932f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:28.385314 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175a03-e002-4f76-8180-3db85d1932f4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:28.389170 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892592-6616-44e0-80fc-dd1657c1e051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:28.389786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892592-6616-44e0-80fc-dd1657c1e051 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:28.390062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892592-6616-44e0-80fc-dd1657c1e051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:28.390331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892592-6616-44e0-80fc-dd1657c1e051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:28.400563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e892592-6616-44e0-80fc-dd1657c1e051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:28.402004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e892592-6616-44e0-80fc-dd1657c1e051 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:28.412588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1060/2118] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:32.806086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bc1bb-46bb-4b17-a5dd-b752a54aac19 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:32.806574 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bc1bb-46bb-4b17-a5dd-b752a54aac19 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:32.806675 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bc1bb-46bb-4b17-a5dd-b752a54aac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:32.847188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0a2bc1bb-46bb-4b17-a5dd-b752a54aac19 None None] MFA Rules not processed for user `41f160ae0e09481594bad75cb84e9a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:32.848958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0a2bc1bb-46bb-4b17-a5dd-b752a54aac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:32.930448 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1059/2119] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:32.945275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892592-6616-44e0-80fc-dd1657c1e051 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:32.946808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1e892592-6616-44e0-80fc-dd1657c1e051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:33.027784 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:33.035918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892592-6616-44e0-80fc-dd1657c1e051 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:33.043727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5450d-5a89-427e-a11f-5ab4323c92b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:33.044346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5450d-5a89-427e-a11f-5ab4323c92b0 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:33.044620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5450d-5a89-427e-a11f-5ab4323c92b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:33.044889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5450d-5a89-427e-a11f-5ab4323c92b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:33.053418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5450d-5a89-427e-a11f-5ab4323c92b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:33.055044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5450d-5a89-427e-a11f-5ab4323c92b0 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:33.065395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1061/2120] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:34.435681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0bb4-f2c6-4ab6-95e0-02b4805cf502 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:34.436149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0bb4-f2c6-4ab6-95e0-02b4805cf502 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:34.436252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0bb4-f2c6-4ab6-95e0-02b4805cf502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:34.445059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:34.464266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b5af0bb4-f2c6-4ab6-95e0-02b4805cf502 None None] MFA Rules not processed for user `41f160ae0e09481594bad75cb84e9a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:34.472955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b5af0bb4-f2c6-4ab6-95e0-02b4805cf502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:34.485057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1060/2121] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:34.797935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5450d-5a89-427e-a11f-5ab4323c92b0 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:34.799957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-15b5450d-5a89-427e-a11f-5ab4323c92b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:34.824303 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5450d-5a89-427e-a11f-5ab4323c92b0 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:34.834253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620f451-243b-45f0-afc6-d10a96d19e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:34.835014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f451-243b-45f0-afc6-d10a96d19e22 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:34.835397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f451-243b-45f0-afc6-d10a96d19e22 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:34.835770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f451-243b-45f0-afc6-d10a96d19e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:34.838282 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9620f451-243b-45f0-afc6-d10a96d19e22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:34.863941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af0bb4-f2c6-4ab6-95e0-02b4805cf502 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:34.874588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af0bb4-f2c6-4ab6-95e0-02b4805cf502 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:34.879623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba0478-0379-413a-8209-0d95df17206d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:34.880453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba0478-0379-413a-8209-0d95df17206d service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:34.880880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba0478-0379-413a-8209-0d95df17206d service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:34.881350 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba0478-0379-413a-8209-0d95df17206d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:34.884768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0eba0478-0379-413a-8209-0d95df17206d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:34.898991 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba0478-0379-413a-8209-0d95df17206d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:34.900548 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba0478-0379-413a-8209-0d95df17206d service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:34.910249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1061/2122] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:32:34.914132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620f451-243b-45f0-afc6-d10a96d19e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:34.916045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620f451-243b-45f0-afc6-d10a96d19e22 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:34.929192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1062/2123] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:35.596140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba0478-0379-413a-8209-0d95df17206d service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:35.598099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0eba0478-0379-413a-8209-0d95df17206d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:35.695292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba0478-0379-413a-8209-0d95df17206d service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:35.702205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7250f3-24f3-4744-b9a2-90548794c48a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:35.702865 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7250f3-24f3-4744-b9a2-90548794c48a service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:35.703659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7250f3-24f3-4744-b9a2-90548794c48a service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:35.703961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7250f3-24f3-4744-b9a2-90548794c48a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:35.706342 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-da7250f3-24f3-4744-b9a2-90548794c48a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:35.720601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7250f3-24f3-4744-b9a2-90548794c48a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:35.722237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7250f3-24f3-4744-b9a2-90548794c48a service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:35.734517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1062/2124] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:38.008621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620f451-243b-45f0-afc6-d10a96d19e22 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:38.023714 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620f451-243b-45f0-afc6-d10a96d19e22 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:38.030889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb20680-bd6b-440f-8cf6-ae05075d5b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:38.031510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb20680-bd6b-440f-8cf6-ae05075d5b07 service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:38.032598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb20680-bd6b-440f-8cf6-ae05075d5b07 service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:38.032876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb20680-bd6b-440f-8cf6-ae05075d5b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:38.034981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2fb20680-bd6b-440f-8cf6-ae05075d5b07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:38.049800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb20680-bd6b-440f-8cf6-ae05075d5b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:38.051595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb20680-bd6b-440f-8cf6-ae05075d5b07 service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:38.077774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1063/2125] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:39.267496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7250f3-24f3-4744-b9a2-90548794c48a service placement] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:39.280600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7250f3-24f3-4744-b9a2-90548794c48a service placement] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:39.285452 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee8756-012c-4b91-9bab-c9a8b55dbec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:39.286309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee8756-012c-4b91-9bab-c9a8b55dbec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:39.286864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee8756-012c-4b91-9bab-c9a8b55dbec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:39.287483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee8756-012c-4b91-9bab-c9a8b55dbec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:39.308735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fbee8756-012c-4b91-9bab-c9a8b55dbec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:39.338735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee8756-012c-4b91-9bab-c9a8b55dbec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:39.344360 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee8756-012c-4b91-9bab-c9a8b55dbec2 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:39.363949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1063/2126] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:44.237487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb20680-bd6b-440f-8cf6-ae05075d5b07 service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:44.238969 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2fb20680-bd6b-440f-8cf6-ae05075d5b07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:44.252267 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb20680-bd6b-440f-8cf6-ae05075d5b07 service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:44.255988 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d0b9-dc9a-47be-aa31-f470ca336fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:44.256604 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d0b9-dc9a-47be-aa31-f470ca336fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:44.256873 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d0b9-dc9a-47be-aa31-f470ca336fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:44.257173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d0b9-dc9a-47be-aa31-f470ca336fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:44.259129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e706d0b9-dc9a-47be-aa31-f470ca336fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:44.272366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d0b9-dc9a-47be-aa31-f470ca336fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:44.273833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d0b9-dc9a-47be-aa31-f470ca336fd6 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:44.284528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1064/2127] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:45.353990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee8756-012c-4b91-9bab-c9a8b55dbec2 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:45.377097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee8756-012c-4b91-9bab-c9a8b55dbec2 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:45.385570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329819ec-ea5c-402e-8d2a-39bdb021145f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:45.386452 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329819ec-ea5c-402e-8d2a-39bdb021145f service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:45.386827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329819ec-ea5c-402e-8d2a-39bdb021145f service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:45.387874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329819ec-ea5c-402e-8d2a-39bdb021145f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:45.390156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-329819ec-ea5c-402e-8d2a-39bdb021145f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:45.405150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329819ec-ea5c-402e-8d2a-39bdb021145f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:45.408063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329819ec-ea5c-402e-8d2a-39bdb021145f service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:45.426299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1064/2128] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:48.526589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d0b9-dc9a-47be-aa31-f470ca336fd6 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:48.528727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e706d0b9-dc9a-47be-aa31-f470ca336fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:48.542163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d0b9-dc9a-47be-aa31-f470ca336fd6 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:48.546957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:48.548377 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:48.548630 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:48.549276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] PATH_INFO: `/v3/users/eb19406216904864b983404a0ce65e1f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:48.550473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb19406216904864b983404a0ce65e1f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:48.552831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:48.611505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb19406216904864b983404a0ce65e1f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:48.612466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb19406216904864b983404a0ce65e1f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:48.620449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb19406216904864b983404a0ce65e1f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:48.621335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb19406216904864b983404a0ce65e1f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:48.635616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-65a353f7-5af6-4f2c-8320-453977a5a064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb19406216904864b983404a0ce65e1f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:48.649965 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1065/2129] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:32:48 2022] DELETE /identity/v3/users/eb19406216904864b983404a0ce65e1f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:48.894181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329819ec-ea5c-402e-8d2a-39bdb021145f service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:48.910615 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329819ec-ea5c-402e-8d2a-39bdb021145f service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:48.983549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:48.984202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:48.985087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:48.985327 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] PATH_INFO: `/v3/projects/d02613e648814da8a1bda99cd56cc720` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:48.986625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02613e648814da8a1bda99cd56cc720)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:48.988545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:49.039391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:49.040969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02613e648814da8a1bda99cd56cc720', 'request_id': 'req-8733de00-7987-46d7-9e76-b9f276bbbfc2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:49.051333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02613e648814da8a1bda99cd56cc720', 'request_id': 'req-8733de00-7987-46d7-9e76-b9f276bbbfc2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:49.058631 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02613e648814da8a1bda99cd56cc720', 'request_id': 'req-8733de00-7987-46d7-9e76-b9f276bbbfc2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:49.071441 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] The token cache is being invalidate because project d02613e648814da8a1bda99cd56cc720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:32:49.071647 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:49.072285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8733de00-7987-46d7-9e76-b9f276bbbfc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:49.073964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1065/2130] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:32:48 2022] DELETE /identity/v3/projects/d02613e648814da8a1bda99cd56cc720 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:32:49.078979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fe210-6e02-457b-8f6a-295c78070d64 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.079761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fe210-6e02-457b-8f6a-295c78070d64 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.079761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fe210-6e02-457b-8f6a-295c78070d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.103217 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-847fe210-6e02-457b-8f6a-295c78070d64 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:49.105573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-847fe210-6e02-457b-8f6a-295c78070d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:49.142829 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:49.177669 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1066/2131] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:32:49.185787 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6e77e-0dfb-456c-bce9-32768886dc96 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.186062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6e77e-0dfb-456c-bce9-32768886dc96 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.186339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6e77e-0dfb-456c-bce9-32768886dc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.212530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-15e6e77e-0dfb-456c-bce9-32768886dc96 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:49.213809 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-15e6e77e-0dfb-456c-bce9-32768886dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:49.222913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1066/2132] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:49.227503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fe210-6e02-457b-8f6a-295c78070d64 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:49.239619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fe210-6e02-457b-8f6a-295c78070d64 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:49.245119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adb210-57c2-474b-82cd-6059ad176037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:49.245823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adb210-57c2-474b-82cd-6059ad176037 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.246163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adb210-57c2-474b-82cd-6059ad176037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.246507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adb210-57c2-474b-82cd-6059ad176037 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.247223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adb210-57c2-474b-82cd-6059ad176037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:32:49.247591 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adb210-57c2-474b-82cd-6059ad176037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:49.249284 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adb210-57c2-474b-82cd-6059ad176037 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:49.267402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1067/2133] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:32:49.276006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6e77e-0dfb-456c-bce9-32768886dc96 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:49.285468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6e77e-0dfb-456c-bce9-32768886dc96 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:49.290223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed2e15-d74d-4316-bb57-3fe10305f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:49.290850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed2e15-d74d-4316-bb57-3fe10305f3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.291306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed2e15-d74d-4316-bb57-3fe10305f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.291674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed2e15-d74d-4316-bb57-3fe10305f3a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.292492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed2e15-d74d-4316-bb57-3fe10305f3a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:49.294416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed2e15-d74d-4316-bb57-3fe10305f3a8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:49.331520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1067/2134] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:32:49 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:32:49.332414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adb210-57c2-474b-82cd-6059ad176037 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:49.348112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adb210-57c2-474b-82cd-6059ad176037 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:49.428251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253cb14-0d18-4b0e-a216-ac8eaa2bd1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:49.429281 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253cb14-0d18-4b0e-a216-ac8eaa2bd1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.430229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253cb14-0d18-4b0e-a216-ac8eaa2bd1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.430716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253cb14-0d18-4b0e-a216-ac8eaa2bd1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.431752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253cb14-0d18-4b0e-a216-ac8eaa2bd1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:49.434920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253cb14-0d18-4b0e-a216-ac8eaa2bd1e6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:49.469799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1068/2135] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:32:49 2022] POST /identity/v3/users => generated 279 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:32:49.474654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed2e15-d74d-4316-bb57-3fe10305f3a8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:49.489958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed2e15-d74d-4316-bb57-3fe10305f3a8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:49.510141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8878-7d38-40e1-9d23-002cb8b33ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:49.510141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8878-7d38-40e1-9d23-002cb8b33ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.510141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8878-7d38-40e1-9d23-002cb8b33ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.510141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8878-7d38-40e1-9d23-002cb8b33ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.510445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc8878-7d38-40e1-9d23-002cb8b33ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:49.510667 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc8878-7d38-40e1-9d23-002cb8b33ac3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:49.523584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1068/2136] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:32:49.527915 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253cb14-0d18-4b0e-a216-ac8eaa2bd1e6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:49.538892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253cb14-0d18-4b0e-a216-ac8eaa2bd1e6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:49.544541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966724aa-6032-4fd8-b840-d32a3396e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:49.545309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966724aa-6032-4fd8-b840-d32a3396e157 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.546146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966724aa-6032-4fd8-b840-d32a3396e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.546430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966724aa-6032-4fd8-b840-d32a3396e157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.547637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966724aa-6032-4fd8-b840-d32a3396e157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:49.549958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966724aa-6032-4fd8-b840-d32a3396e157 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:49.570287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1069/2137] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:32:49.574497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8878-7d38-40e1-9d23-002cb8b33ac3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:49.585798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8878-7d38-40e1-9d23-002cb8b33ac3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:49.591075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef031f75-8663-4b8d-b3b5-68aced2df50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:49.592262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef031f75-8663-4b8d-b3b5-68aced2df50a admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.593120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef031f75-8663-4b8d-b3b5-68aced2df50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.593631 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef031f75-8663-4b8d-b3b5-68aced2df50a admin admin] PATH_INFO: `/v3/projects/20fdc717e23242f19d4c3386d5fe3a2b/users/3f99fd14ce9943d5a1db606c0320bb40/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.611836 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef031f75-8663-4b8d-b3b5-68aced2df50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fdc717e23242f19d4c3386d5fe3a2b, user_id=3f99fd14ce9943d5a1db606c0320bb40, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:49.615065 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef031f75-8663-4b8d-b3b5-68aced2df50a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:49.632979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1069/2138] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:32:49 2022] PUT /identity/v3/projects/20fdc717e23242f19d4c3386d5fe3a2b/users/3f99fd14ce9943d5a1db606c0320bb40/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:49.645620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0337f2-be5f-4712-ad8b-9415ff31c7f2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.646161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0337f2-be5f-4712-ad8b-9415ff31c7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.646424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0337f2-be5f-4712-ad8b-9415ff31c7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.706165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cc0337f2-be5f-4712-ad8b-9415ff31c7f2 None None] MFA Rules not processed for user `3f99fd14ce9943d5a1db606c0320bb40`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:49.707739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cc0337f2-be5f-4712-ad8b-9415ff31c7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:49.824189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1070/2139] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:49.826513 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef031f75-8663-4b8d-b3b5-68aced2df50a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:49.956871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef031f75-8663-4b8d-b3b5-68aced2df50a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:49.972470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34aa685-b0e2-4cff-8403-275519dc6a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:49.974328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34aa685-b0e2-4cff-8403-275519dc6a98 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.974687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34aa685-b0e2-4cff-8403-275519dc6a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.976154 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34aa685-b0e2-4cff-8403-275519dc6a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.977039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34aa685-b0e2-4cff-8403-275519dc6a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:49.980199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34aa685-b0e2-4cff-8403-275519dc6a98 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:50.017491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1070/2140] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:32:49 2022] POST /identity/v3/projects => generated 357 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:32:50.021554 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0337f2-be5f-4712-ad8b-9415ff31c7f2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:50.035252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0337f2-be5f-4712-ad8b-9415ff31c7f2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:50.078738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:50.121647 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b92dfa-f57d-4e28-ac78-720dbfb5728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:50.122608 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92dfa-f57d-4e28-ac78-720dbfb5728b admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.124252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92dfa-f57d-4e28-ac78-720dbfb5728b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.124252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92dfa-f57d-4e28-ac78-720dbfb5728b admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.124252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b92dfa-f57d-4e28-ac78-720dbfb5728b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:50.127413 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b92dfa-f57d-4e28-ac78-720dbfb5728b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:50.160786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1071/2141] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:32:50 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:32:50.164871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34aa685-b0e2-4cff-8403-275519dc6a98 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:50.178814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34aa685-b0e2-4cff-8403-275519dc6a98 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:50.188233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d5f3-18a2-40d9-b09f-b992fd452ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:50.199025 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d5f3-18a2-40d9-b09f-b992fd452ada admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.199423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d5f3-18a2-40d9-b09f-b992fd452ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.199598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d5f3-18a2-40d9-b09f-b992fd452ada admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.200260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531d5f3-18a2-40d9-b09f-b992fd452ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:50.202614 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531d5f3-18a2-40d9-b09f-b992fd452ada admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:50.230551 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1071/2142] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:32:50.232917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96d50-a882-45ea-9379-c711497603e2 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.233547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96d50-a882-45ea-9379-c711497603e2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.233838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96d50-a882-45ea-9379-c711497603e2 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.235922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1072/2143] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:50.238963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d5f3-18a2-40d9-b09f-b992fd452ada admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:50.245872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78f0f-0e46-4de3-af7e-d1aac0c19b84 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.246543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78f0f-0e46-4de3-af7e-d1aac0c19b84 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.246918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78f0f-0e46-4de3-af7e-d1aac0c19b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.264537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d5f3-18a2-40d9-b09f-b992fd452ada admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:50.273753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d8b78f0f-0e46-4de3-af7e-d1aac0c19b84 None None] MFA Rules not processed for user `7f1a24bf15594b12bbf59741fcb46cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:50.275221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d8b78f0f-0e46-4de3-af7e-d1aac0c19b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:50.279480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7ec55-6c63-485d-9f7d-104f621520f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:50.280645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7ec55-6c63-485d-9f7d-104f621520f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.280955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7ec55-6c63-485d-9f7d-104f621520f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.283612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7ec55-6c63-485d-9f7d-104f621520f7 admin admin] PATH_INFO: `/v3/projects/be84f75a10ee401bafe9d0ec099e25b2/users/e83d37f2383f451397ab206acde1200f/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.320562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7ec55-6c63-485d-9f7d-104f621520f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be84f75a10ee401bafe9d0ec099e25b2, user_id=e83d37f2383f451397ab206acde1200f, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:50.324050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7ec55-6c63-485d-9f7d-104f621520f7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:50.359236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1072/2144] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:32:50 2022] PUT /identity/v3/projects/be84f75a10ee401bafe9d0ec099e25b2/users/e83d37f2383f451397ab206acde1200f/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:50.363529 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7ec55-6c63-485d-9f7d-104f621520f7 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:50.379640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1073/2145] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:32:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:32:50.394262 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:50.400805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b78f0f-0e46-4de3-af7e-d1aac0c19b84 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:50.402631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d8b78f0f-0e46-4de3-af7e-d1aac0c19b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:50.424469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b78f0f-0e46-4de3-af7e-d1aac0c19b84 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:50.455303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7ec55-6c63-485d-9f7d-104f621520f7 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:50.461924 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea72d8-f13b-4de0-84f5-bbd7f24bb9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:50.462591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea72d8-f13b-4de0-84f5-bbd7f24bb9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.462920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea72d8-f13b-4de0-84f5-bbd7f24bb9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.463332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea72d8-f13b-4de0-84f5-bbd7f24bb9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.464011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea72d8-f13b-4de0-84f5-bbd7f24bb9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:50.465789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea72d8-f13b-4de0-84f5-bbd7f24bb9fe admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:50.477327 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1073/2146] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:32:50.481249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea72d8-f13b-4de0-84f5-bbd7f24bb9fe admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:50.492129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2dff2-7631-4716-a97d-89b2938ce5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:50.492436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea72d8-f13b-4de0-84f5-bbd7f24bb9fe admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:50.493540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2dff2-7631-4716-a97d-89b2938ce5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.493540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2dff2-7631-4716-a97d-89b2938ce5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.493540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2dff2-7631-4716-a97d-89b2938ce5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.497083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb39563-01cb-4c0d-828a-98a6ca309c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:50.497722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb39563-01cb-4c0d-828a-98a6ca309c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.498003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb39563-01cb-4c0d-828a-98a6ca309c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.498271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb39563-01cb-4c0d-828a-98a6ca309c17 admin admin] PATH_INFO: `/v3/projects/be84f75a10ee401bafe9d0ec099e25b2/users/e83d37f2383f451397ab206acde1200f/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.501101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb39563-01cb-4c0d-828a-98a6ca309c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be84f75a10ee401bafe9d0ec099e25b2, user_id=e83d37f2383f451397ab206acde1200f, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:50.501695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2dff2-7631-4716-a97d-89b2938ce5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:50.503108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2dff2-7631-4716-a97d-89b2938ce5c0 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:50.503724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb39563-01cb-4c0d-828a-98a6ca309c17 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:50.512310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1074/2147] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:50.516263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1074/2148] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:32:50 2022] PUT /identity/v3/projects/be84f75a10ee401bafe9d0ec099e25b2/users/e83d37f2383f451397ab206acde1200f/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:32:50.526801 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977f22-4c55-408a-9011-08d11a24adec None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.527087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977f22-4c55-408a-9011-08d11a24adec None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.527358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977f22-4c55-408a-9011-08d11a24adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.558004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0e977f22-4c55-408a-9011-08d11a24adec None None] MFA Rules not processed for user `e83d37f2383f451397ab206acde1200f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:50.559870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0e977f22-4c55-408a-9011-08d11a24adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:50.601919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8011-f53f-4456-9cae-f17445821a92 None None] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.602452 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8011-f53f-4456-9cae-f17445821a92 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.602721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8011-f53f-4456-9cae-f17445821a92 None None] PATH_INFO: `/` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.604250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1075/2149] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:32:50.610223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617ed28-8da5-4eaf-8d17-e98f91b58050 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.610465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617ed28-8da5-4eaf-8d17-e98f91b58050 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.610740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617ed28-8da5-4eaf-8d17-e98f91b58050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.632693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:50.633955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c617ed28-8da5-4eaf-8d17-e98f91b58050 None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:50.636042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c617ed28-8da5-4eaf-8d17-e98f91b58050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:50.639314 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1075/2150] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:50.650863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977f22-4c55-408a-9011-08d11a24adec None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:50.652390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0e977f22-4c55-408a-9011-08d11a24adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:50.720118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1076/2151] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:32:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:32:50.731679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977f22-4c55-408a-9011-08d11a24adec None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:50.736394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c16b4-551d-48c8-baa6-93b3cbf8b324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:50.737159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c16b4-551d-48c8-baa6-93b3cbf8b324 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.737423 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c16b4-551d-48c8-baa6-93b3cbf8b324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.737691 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c16b4-551d-48c8-baa6-93b3cbf8b324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.738173 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617ed28-8da5-4eaf-8d17-e98f91b58050 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:50.748637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c16b4-551d-48c8-baa6-93b3cbf8b324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:50.750371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c16b4-551d-48c8-baa6-93b3cbf8b324 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:50.760989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1076/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:32:50.821637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c16b4-551d-48c8-baa6-93b3cbf8b324 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:50.821839 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617ed28-8da5-4eaf-8d17-e98f91b58050 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:50.825761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd515-96d6-45a3-ba36-f2ede21e43c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:50.826381 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd515-96d6-45a3-ba36-f2ede21e43c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.826654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd515-96d6-45a3-ba36-f2ede21e43c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.826931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd515-96d6-45a3-ba36-f2ede21e43c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.832069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c16b4-551d-48c8-baa6-93b3cbf8b324 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:50.835869 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8679ae1-b511-4ebe-b3d0-f9dccdae574a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:50.836464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8679ae1-b511-4ebe-b3d0-f9dccdae574a service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.836735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8679ae1-b511-4ebe-b3d0-f9dccdae574a service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.837025 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8679ae1-b511-4ebe-b3d0-f9dccdae574a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.839000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d8679ae1-b511-4ebe-b3d0-f9dccdae574a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:50.840278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd515-96d6-45a3-ba36-f2ede21e43c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:50.841918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd515-96d6-45a3-ba36-f2ede21e43c2 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:50.855480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1077/2153] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:50.867277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd515-96d6-45a3-ba36-f2ede21e43c2 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:50.882258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd515-96d6-45a3-ba36-f2ede21e43c2 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:50.887096 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f092d1b-7c83-4dff-ab60-4300e3b701e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:50.887714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f092d1b-7c83-4dff-ab60-4300e3b701e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:50.888053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f092d1b-7c83-4dff-ab60-4300e3b701e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:50.888392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f092d1b-7c83-4dff-ab60-4300e3b701e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:50.938795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8679ae1-b511-4ebe-b3d0-f9dccdae574a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:50.940280 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8679ae1-b511-4ebe-b3d0-f9dccdae574a service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:50.953367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1077/2154] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:32:50.962960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:50.997268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f092d1b-7c83-4dff-ab60-4300e3b701e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:50.999128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f092d1b-7c83-4dff-ab60-4300e3b701e7 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:51.010845 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1078/2155] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:55.156040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8679ae1-b511-4ebe-b3d0-f9dccdae574a service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:55.158683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d8679ae1-b511-4ebe-b3d0-f9dccdae574a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:55.173645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8679ae1-b511-4ebe-b3d0-f9dccdae574a service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:55.178877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:55.179867 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:55.180360 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:55.180958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] PATH_INFO: `/v3/users/78bec0414d064ed8901271fc4c57cfe5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:55.182417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78bec0414d064ed8901271fc4c57cfe5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:55.185088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:55.245843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78bec0414d064ed8901271fc4c57cfe5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:55.246513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78bec0414d064ed8901271fc4c57cfe5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:55.255554 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78bec0414d064ed8901271fc4c57cfe5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:55.256280 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78bec0414d064ed8901271fc4c57cfe5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:55.269031 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9f169123-fb7d-495e-a4f0-4de0ae9dc20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78bec0414d064ed8901271fc4c57cfe5'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:55.283186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1078/2156] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:32:55 2022] DELETE /identity/v3/users/78bec0414d064ed8901271fc4c57cfe5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:55.480100 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f092d1b-7c83-4dff-ab60-4300e3b701e7 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:55.505189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f092d1b-7c83-4dff-ab60-4300e3b701e7 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:55.625655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:55.626399 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:55.626728 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:55.627015 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] PATH_INFO: `/v3/projects/608ff9d8e9814608b54e3c451f317e2f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:55.628157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=608ff9d8e9814608b54e3c451f317e2f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:55.630459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:55.687052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608ff9d8e9814608b54e3c451f317e2f', 'request_id': 'req-cf6f3135-601b-4bcf-a713-ea96b66ed88c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:55.695294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608ff9d8e9814608b54e3c451f317e2f', 'request_id': 'req-cf6f3135-601b-4bcf-a713-ea96b66ed88c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:55.701979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608ff9d8e9814608b54e3c451f317e2f', 'request_id': 'req-cf6f3135-601b-4bcf-a713-ea96b66ed88c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:55.716439 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] The token cache is being invalidate because project 608ff9d8e9814608b54e3c451f317e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:32:55.716729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:55.717395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cf6f3135-601b-4bcf-a713-ea96b66ed88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:32:55.723344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1079/2157] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:32:55 2022] DELETE /identity/v3/projects/608ff9d8e9814608b54e3c451f317e2f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:55.725038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5fa90-988b-4938-857d-0db3dbe6fb28 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:55.725238 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5fa90-988b-4938-857d-0db3dbe6fb28 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:55.725528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5fa90-988b-4938-857d-0db3dbe6fb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:55.740008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:55.746564 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-d4a5fa90-988b-4938-857d-0db3dbe6fb28 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:55.748664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-d4a5fa90-988b-4938-857d-0db3dbe6fb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:55.809449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1079/2158] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:32:55.817490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fc0a-f916-4bd5-98c5-0d5054679391 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:55.817767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fc0a-f916-4bd5-98c5-0d5054679391 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:55.818039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988fc0a-f916-4bd5-98c5-0d5054679391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:55.839939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5988fc0a-f916-4bd5-98c5-0d5054679391 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:55.841174 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5988fc0a-f916-4bd5-98c5-0d5054679391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:55.850007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1080/2159] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:55.854364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5fa90-988b-4938-857d-0db3dbe6fb28 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:55.864181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5fa90-988b-4938-857d-0db3dbe6fb28 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:55.868747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3a97b-8398-41fa-8e07-debe1cb1fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:55.869439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3a97b-8398-41fa-8e07-debe1cb1fb76 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:55.869740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3a97b-8398-41fa-8e07-debe1cb1fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:55.870034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3a97b-8398-41fa-8e07-debe1cb1fb76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:55.870667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3a97b-8398-41fa-8e07-debe1cb1fb76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:32:55.870963 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3a97b-8398-41fa-8e07-debe1cb1fb76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:55.872538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3a97b-8398-41fa-8e07-debe1cb1fb76 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:55.884165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1080/2160] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:32:55.888403 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988fc0a-f916-4bd5-98c5-0d5054679391 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:55.898206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988fc0a-f916-4bd5-98c5-0d5054679391 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:55.902924 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4240-53c4-4268-8191-1318849f9940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:55.903512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4240-53c4-4268-8191-1318849f9940 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:55.903786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4240-53c4-4268-8191-1318849f9940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:55.904054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4240-53c4-4268-8191-1318849f9940 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:55.904688 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc4240-53c4-4268-8191-1318849f9940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:55.907356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc4240-53c4-4268-8191-1318849f9940 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:55.935954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1081/2161] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:32:55 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:32:55.940720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3a97b-8398-41fa-8e07-debe1cb1fb76 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:55.950714 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3a97b-8398-41fa-8e07-debe1cb1fb76 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:56.006847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3807-16bf-496a-b1d1-1824f55c5ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:56.007432 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3807-16bf-496a-b1d1-1824f55c5ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:56.007706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3807-16bf-496a-b1d1-1824f55c5ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:56.007976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3807-16bf-496a-b1d1-1824f55c5ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:56.008583 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d3807-16bf-496a-b1d1-1824f55c5ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:56.010510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d3807-16bf-496a-b1d1-1824f55c5ca6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:56.031337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1081/2162] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:32:55 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:32:56.035589 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4240-53c4-4268-8191-1318849f9940 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:56.045885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4240-53c4-4268-8191-1318849f9940 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:56.050498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a86fcc-c626-46b6-b6b5-3436c9f9c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:56.051078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86fcc-c626-46b6-b6b5-3436c9f9c113 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:56.051353 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86fcc-c626-46b6-b6b5-3436c9f9c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:56.051621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a86fcc-c626-46b6-b6b5-3436c9f9c113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:56.052244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a86fcc-c626-46b6-b6b5-3436c9f9c113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:56.053866 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a86fcc-c626-46b6-b6b5-3436c9f9c113 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:56.064069 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1082/2163] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:32:56.068104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3807-16bf-496a-b1d1-1824f55c5ca6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:56.080056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3807-16bf-496a-b1d1-1824f55c5ca6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:56.084940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c26cc-3938-4818-ae20-be3ab3f33d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:56.085579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c26cc-3938-4818-ae20-be3ab3f33d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:56.085881 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c26cc-3938-4818-ae20-be3ab3f33d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:56.086151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c26cc-3938-4818-ae20-be3ab3f33d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:56.086783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c26cc-3938-4818-ae20-be3ab3f33d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:56.089237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c26cc-3938-4818-ae20-be3ab3f33d65 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:56.104817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1082/2164] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:32:56.106185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a86fcc-c626-46b6-b6b5-3436c9f9c113 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:56.115979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a86fcc-c626-46b6-b6b5-3436c9f9c113 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:56.120827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8772-a0e7-4b52-8183-6c824c7d3946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:56.121559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8772-a0e7-4b52-8183-6c824c7d3946 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:56.121834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8772-a0e7-4b52-8183-6c824c7d3946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:56.122101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8772-a0e7-4b52-8183-6c824c7d3946 admin admin] PATH_INFO: `/v3/projects/63548fece0784b899649032ec4bc9366/users/553e1add5e924214a27a3ac882403fe6/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:56.137202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f8772-a0e7-4b52-8183-6c824c7d3946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63548fece0784b899649032ec4bc9366, user_id=553e1add5e924214a27a3ac882403fe6, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:56.139818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f8772-a0e7-4b52-8183-6c824c7d3946 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:56.153170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1083/2165] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:32:56 2022] PUT /identity/v3/projects/63548fece0784b899649032ec4bc9366/users/553e1add5e924214a27a3ac882403fe6/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:32:56.163439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae9bdc-2af7-4e54-a8c5-8c4a63cab14d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:56.163927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae9bdc-2af7-4e54-a8c5-8c4a63cab14d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:56.164072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae9bdc-2af7-4e54-a8c5-8c4a63cab14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:56.192680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-80ae9bdc-2af7-4e54-a8c5-8c4a63cab14d None None] MFA Rules not processed for user `553e1add5e924214a27a3ac882403fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:56.193918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-80ae9bdc-2af7-4e54-a8c5-8c4a63cab14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:56.256567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1083/2166] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:32:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:56.268583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8772-a0e7-4b52-8183-6c824c7d3946 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:56.270723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-557f8772-a0e7-4b52-8183-6c824c7d3946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:56.277190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:56.347275 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8772-a0e7-4b52-8183-6c824c7d3946 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:56.353033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1be261-2452-4d38-a4c2-82e9c68fb1df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:56.353643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1be261-2452-4d38-a4c2-82e9c68fb1df service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:56.353917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1be261-2452-4d38-a4c2-82e9c68fb1df service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:56.354185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1be261-2452-4d38-a4c2-82e9c68fb1df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:56.363068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1be261-2452-4d38-a4c2-82e9c68fb1df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:56.364657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1be261-2452-4d38-a4c2-82e9c68fb1df service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:56.373385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1084/2167] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:01.604398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae9bdc-2af7-4e54-a8c5-8c4a63cab14d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:01.606885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:01.665533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae9bdc-2af7-4e54-a8c5-8c4a63cab14d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:01.671579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:01.672626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:01.673635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:01.674005 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] PATH_INFO: `/v3/users/553e1add5e924214a27a3ac882403fe6` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:01.675508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=553e1add5e924214a27a3ac882403fe6)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:01.677447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:01.723255 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553e1add5e924214a27a3ac882403fe6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:01.723924 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553e1add5e924214a27a3ac882403fe6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:01.731004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553e1add5e924214a27a3ac882403fe6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:01.731561 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553e1add5e924214a27a3ac882403fe6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:01.743837 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553e1add5e924214a27a3ac882403fe6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:01.757040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1084/2168] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:01 2022] DELETE /identity/v3/users/553e1add5e924214a27a3ac882403fe6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:01.761547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861eb27-63dd-43f8-a5ee-7c923d948edf None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:01.762026 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861eb27-63dd-43f8-a5ee-7c923d948edf None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:01.762139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861eb27-63dd-43f8-a5ee-7c923d948edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:01.780746 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-7861eb27-63dd-43f8-a5ee-7c923d948edf None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:01.781984 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7861eb27-63dd-43f8-a5ee-7c923d948edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:01.839520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1085/2169] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:01.849517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:01.850971 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:01.907250 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec367e3-db52-454b-86b3-59b172179adf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:01.911738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a505261-25b9-4546-9190-fb72354df0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:01.912342 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a505261-25b9-4546-9190-fb72354df0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:01.912693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a505261-25b9-4546-9190-fb72354df0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:01.912961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a505261-25b9-4546-9190-fb72354df0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:01.922521 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a505261-25b9-4546-9190-fb72354df0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:01.924801 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a505261-25b9-4546-9190-fb72354df0e2 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:01.934206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1085/2170] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:02.208357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861eb27-63dd-43f8-a5ee-7c923d948edf None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:02.210265 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7861eb27-63dd-43f8-a5ee-7c923d948edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:02.223880 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861eb27-63dd-43f8-a5ee-7c923d948edf None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:02.228515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:02.229177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.229455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.229850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] PATH_INFO: `/v3/projects/63548fece0784b899649032ec4bc9366` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.230977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=63548fece0784b899649032ec4bc9366)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:02.232875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:02.281503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63548fece0784b899649032ec4bc9366', 'request_id': 'req-8574f3bb-45f1-4042-b493-5f00e3cd2efc'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:02.288749 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63548fece0784b899649032ec4bc9366', 'request_id': 'req-8574f3bb-45f1-4042-b493-5f00e3cd2efc'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:02.294319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63548fece0784b899649032ec4bc9366', 'request_id': 'req-8574f3bb-45f1-4042-b493-5f00e3cd2efc'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:02.305765 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] The token cache is being invalidate because project 63548fece0784b899649032ec4bc9366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:02.306048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:02.306679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8574f3bb-45f1-4042-b493-5f00e3cd2efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:02.308150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1086/2171] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:02 2022] DELETE /identity/v3/projects/63548fece0784b899649032ec4bc9366 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:02.312929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f298-a9f4-4325-a37c-97ec39a1e100 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.313249 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f298-a9f4-4325-a37c-97ec39a1e100 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.313523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99f298-a9f4-4325-a37c-97ec39a1e100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.333487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1e99f298-a9f4-4325-a37c-97ec39a1e100 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:02.334674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1e99f298-a9f4-4325-a37c-97ec39a1e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:02.352764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:02.395708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1086/2172] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:02.404553 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bacac-2933-448e-a36b-cbcaa95f8107 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.404834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bacac-2933-448e-a36b-cbcaa95f8107 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.405153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bacac-2933-448e-a36b-cbcaa95f8107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.425273 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4c5bacac-2933-448e-a36b-cbcaa95f8107 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:02.426455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4c5bacac-2933-448e-a36b-cbcaa95f8107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:02.434208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1087/2173] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:02.438243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99f298-a9f4-4325-a37c-97ec39a1e100 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:02.448512 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99f298-a9f4-4325-a37c-97ec39a1e100 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:02.453032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c260875-0768-441a-9b45-b03f7da0be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:02.453627 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c260875-0768-441a-9b45-b03f7da0be71 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.453903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c260875-0768-441a-9b45-b03f7da0be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.454173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c260875-0768-441a-9b45-b03f7da0be71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.455080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c260875-0768-441a-9b45-b03f7da0be71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:02.455381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c260875-0768-441a-9b45-b03f7da0be71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:02.456960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c260875-0768-441a-9b45-b03f7da0be71 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:02.468234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1087/2174] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:33:02.472337 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bacac-2933-448e-a36b-cbcaa95f8107 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:02.481790 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bacac-2933-448e-a36b-cbcaa95f8107 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:02.487136 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28ae39-894f-4772-9f32-4497263598d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:02.487703 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28ae39-894f-4772-9f32-4497263598d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.487975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28ae39-894f-4772-9f32-4497263598d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.488240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28ae39-894f-4772-9f32-4497263598d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.488856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28ae39-894f-4772-9f32-4497263598d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:02.490775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28ae39-894f-4772-9f32-4497263598d2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:02.495187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:02.519094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1088/2175] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:02 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:02.523270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c260875-0768-441a-9b45-b03f7da0be71 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:02.534133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c260875-0768-441a-9b45-b03f7da0be71 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:02.589328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac02495-22e6-4db2-b63a-0ca0a96cae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:02.589935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac02495-22e6-4db2-b63a-0ca0a96cae91 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.590198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac02495-22e6-4db2-b63a-0ca0a96cae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.590470 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac02495-22e6-4db2-b63a-0ca0a96cae91 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.591101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac02495-22e6-4db2-b63a-0ca0a96cae91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:02.593040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac02495-22e6-4db2-b63a-0ca0a96cae91 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:02.615436 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1088/2176] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:02 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:33:02.619490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28ae39-894f-4772-9f32-4497263598d2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:02.629665 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28ae39-894f-4772-9f32-4497263598d2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:02.634229 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c3741-3322-45de-a37c-33c555e60f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:02.634813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c3741-3322-45de-a37c-33c555e60f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.635085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c3741-3322-45de-a37c-33c555e60f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.635359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c3741-3322-45de-a37c-33c555e60f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.635982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c3741-3322-45de-a37c-33c555e60f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:02.637582 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c3741-3322-45de-a37c-33c555e60f95 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:02.647877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1089/2177] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:02.651769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac02495-22e6-4db2-b63a-0ca0a96cae91 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:02.662377 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac02495-22e6-4db2-b63a-0ca0a96cae91 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:02.667325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59459046-b239-4160-bbd9-ec6544b6570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:02.668042 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59459046-b239-4160-bbd9-ec6544b6570e admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.668353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59459046-b239-4160-bbd9-ec6544b6570e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.668741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59459046-b239-4160-bbd9-ec6544b6570e admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.669695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59459046-b239-4160-bbd9-ec6544b6570e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:02.672220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59459046-b239-4160-bbd9-ec6544b6570e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:02.685685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1089/2178] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:02.690622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c3741-3322-45de-a37c-33c555e60f95 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:02.700324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c3741-3322-45de-a37c-33c555e60f95 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:02.705855 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799018cd-67a1-4f00-9521-7c70f9509da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:02.706507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799018cd-67a1-4f00-9521-7c70f9509da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.706778 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799018cd-67a1-4f00-9521-7c70f9509da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.707042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799018cd-67a1-4f00-9521-7c70f9509da1 admin admin] PATH_INFO: `/v3/projects/ee74f205ced040aa9bc73d00ea62e88b/users/2ede0c616a1e4fb185ef2da9b04366e5/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.721512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799018cd-67a1-4f00-9521-7c70f9509da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee74f205ced040aa9bc73d00ea62e88b, user_id=2ede0c616a1e4fb185ef2da9b04366e5, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:02.724532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799018cd-67a1-4f00-9521-7c70f9509da1 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:02.739958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1090/2179] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:02 2022] PUT /identity/v3/projects/ee74f205ced040aa9bc73d00ea62e88b/users/2ede0c616a1e4fb185ef2da9b04366e5/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:02.750243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848614-f3fd-4ccb-b0a8-00e5e6ad57f2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.750525 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848614-f3fd-4ccb-b0a8-00e5e6ad57f2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.750803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848614-f3fd-4ccb-b0a8-00e5e6ad57f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.779102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-97848614-f3fd-4ccb-b0a8-00e5e6ad57f2 None None] MFA Rules not processed for user `2ede0c616a1e4fb185ef2da9b04366e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:02.780299 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-97848614-f3fd-4ccb-b0a8-00e5e6ad57f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:02.850951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1090/2180] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:02.855534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799018cd-67a1-4f00-9521-7c70f9509da1 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:02.917392 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799018cd-67a1-4f00-9521-7c70f9509da1 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:02.922016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14b0e0-cc16-4ef2-ac77-750cfefccd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:02.922608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14b0e0-cc16-4ef2-ac77-750cfefccd80 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:02.922913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14b0e0-cc16-4ef2-ac77-750cfefccd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:02.923242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14b0e0-cc16-4ef2-ac77-750cfefccd80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:02.923883 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14b0e0-cc16-4ef2-ac77-750cfefccd80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:02.925810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14b0e0-cc16-4ef2-ac77-750cfefccd80 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:02.952790 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1091/2181] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:02 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:02.957590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97848614-f3fd-4ccb-b0a8-00e5e6ad57f2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:02.968334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97848614-f3fd-4ccb-b0a8-00e5e6ad57f2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:02.985562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:03.026915 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6504a38-d587-48d6-9492-c2ccd99f9ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:03.027516 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6504a38-d587-48d6-9492-c2ccd99f9ecf admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:03.027788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6504a38-d587-48d6-9492-c2ccd99f9ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:03.028053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6504a38-d587-48d6-9492-c2ccd99f9ecf admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:03.028679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6504a38-d587-48d6-9492-c2ccd99f9ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:03.030603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6504a38-d587-48d6-9492-c2ccd99f9ecf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:03.051705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1091/2182] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:02 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:33:03.055659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14b0e0-cc16-4ef2-ac77-750cfefccd80 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:03.065762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14b0e0-cc16-4ef2-ac77-750cfefccd80 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:03.070227 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a08a4e-353f-4286-8a0e-2479c45c2aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:03.070800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a08a4e-353f-4286-8a0e-2479c45c2aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:03.071073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a08a4e-353f-4286-8a0e-2479c45c2aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:03.071339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a08a4e-353f-4286-8a0e-2479c45c2aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:03.071960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a08a4e-353f-4286-8a0e-2479c45c2aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:03.073602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a08a4e-353f-4286-8a0e-2479c45c2aa4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:03.084747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1092/2183] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:03.088838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6504a38-d587-48d6-9492-c2ccd99f9ecf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:03.099756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6504a38-d587-48d6-9492-c2ccd99f9ecf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:03.104442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdfdf4-def8-49dd-af39-ae5c91433c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:03.104993 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdfdf4-def8-49dd-af39-ae5c91433c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:03.105305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdfdf4-def8-49dd-af39-ae5c91433c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:03.105578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdfdf4-def8-49dd-af39-ae5c91433c3e admin admin] PATH_INFO: `/v3/projects/088eff4209964199913744ca4f05d5b6/users/618eae4a54f9434798f8f4bdc19dced3/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:03.121271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdfdf4-def8-49dd-af39-ae5c91433c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=088eff4209964199913744ca4f05d5b6, user_id=618eae4a54f9434798f8f4bdc19dced3, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:03.123893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdfdf4-def8-49dd-af39-ae5c91433c3e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:03.136567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1092/2184] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:03 2022] PUT /identity/v3/projects/088eff4209964199913744ca4f05d5b6/users/618eae4a54f9434798f8f4bdc19dced3/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:03.140659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a08a4e-353f-4286-8a0e-2479c45c2aa4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:03.151761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a08a4e-353f-4286-8a0e-2479c45c2aa4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:03.218383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66b8e5-df5f-4cfd-92c8-e08083a722b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:03.218383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66b8e5-df5f-4cfd-92c8-e08083a722b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:03.218383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66b8e5-df5f-4cfd-92c8-e08083a722b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:03.218383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66b8e5-df5f-4cfd-92c8-e08083a722b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:03.218780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66b8e5-df5f-4cfd-92c8-e08083a722b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:03.218780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66b8e5-df5f-4cfd-92c8-e08083a722b0 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:03.228407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1093/2185] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:03.232572 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdfdf4-def8-49dd-af39-ae5c91433c3e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:03.243335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdfdf4-def8-49dd-af39-ae5c91433c3e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:03.248055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee95bc-2252-469d-a080-8f978c73db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:03.248706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee95bc-2252-469d-a080-8f978c73db94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:03.249175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee95bc-2252-469d-a080-8f978c73db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:03.249293 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee95bc-2252-469d-a080-8f978c73db94 admin admin] PATH_INFO: `/v3/projects/088eff4209964199913744ca4f05d5b6/users/618eae4a54f9434798f8f4bdc19dced3/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:03.254715 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee95bc-2252-469d-a080-8f978c73db94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088eff4209964199913744ca4f05d5b6, user_id=618eae4a54f9434798f8f4bdc19dced3, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:03.254715 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee95bc-2252-469d-a080-8f978c73db94 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:03.265408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1093/2186] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:03 2022] PUT /identity/v3/projects/088eff4209964199913744ca4f05d5b6/users/618eae4a54f9434798f8f4bdc19dced3/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:03.276012 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9301b-d170-405b-b988-d874d23fa570 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:03.276293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9301b-d170-405b-b988-d874d23fa570 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:03.276564 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9301b-d170-405b-b988-d874d23fa570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:03.309864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4da9301b-d170-405b-b988-d874d23fa570 None None] MFA Rules not processed for user `618eae4a54f9434798f8f4bdc19dced3`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:03.311093 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4da9301b-d170-405b-b988-d874d23fa570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:03.321199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:03.399052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1094/2187] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:03.410410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee95bc-2252-469d-a080-8f978c73db94 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:03.412893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-43ee95bc-2252-469d-a080-8f978c73db94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:03.478964 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee95bc-2252-469d-a080-8f978c73db94 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:03.483926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49896001-f5fa-4af3-9665-0feaef778639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:03.484916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49896001-f5fa-4af3-9665-0feaef778639 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:03.485244 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49896001-f5fa-4af3-9665-0feaef778639 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:03.485540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49896001-f5fa-4af3-9665-0feaef778639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:03.497712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49896001-f5fa-4af3-9665-0feaef778639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:03.499278 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49896001-f5fa-4af3-9665-0feaef778639 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:03.511775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1094/2188] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:04.867327 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9301b-d170-405b-b988-d874d23fa570 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:04.941068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9301b-d170-405b-b988-d874d23fa570 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:04.945944 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:04.946622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:04.946951 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:04.947220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] PATH_INFO: `/v3/users/2ede0c616a1e4fb185ef2da9b04366e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:04.948343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ede0c616a1e4fb185ef2da9b04366e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:04.950276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:05.000911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ede0c616a1e4fb185ef2da9b04366e5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.008759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ede0c616a1e4fb185ef2da9b04366e5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.009399 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ede0c616a1e4fb185ef2da9b04366e5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.022346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ede0c616a1e4fb185ef2da9b04366e5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.029128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ede0c616a1e4fb185ef2da9b04366e5'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.035051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1095/2189] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:04 2022] DELETE /identity/v3/users/2ede0c616a1e4fb185ef2da9b04366e5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:05.039621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb0a1-0e56-44db-b2b4-5272bf6ed0b2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:05.040139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb0a1-0e56-44db-b2b4-5272bf6ed0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:05.040139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb0a1-0e56-44db-b2b4-5272bf6ed0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:05.058769 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5fbdb0a1-0e56-44db-b2b4-5272bf6ed0b2 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:05.060011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5fbdb0a1-0e56-44db-b2b4-5272bf6ed0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:05.121144 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1095/2190] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:05.131681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:05.133066 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:05.161649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:05.194710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f75d4-4b0c-41f2-b074-89eefd82bb0a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:05.198662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bb63d-5068-412b-8bab-c44bc1400690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:05.199261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb63d-5068-412b-8bab-c44bc1400690 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:05.199534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb63d-5068-412b-8bab-c44bc1400690 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:05.199799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bb63d-5068-412b-8bab-c44bc1400690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:05.210320 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bb63d-5068-412b-8bab-c44bc1400690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:05.211990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bb63d-5068-412b-8bab-c44bc1400690 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:05.223062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1096/2191] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:05.494426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdb0a1-0e56-44db-b2b4-5272bf6ed0b2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:05.495856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5fbdb0a1-0e56-44db-b2b4-5272bf6ed0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:05.508438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdb0a1-0e56-44db-b2b4-5272bf6ed0b2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:05.513002 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:05.513724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:05.514071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:05.514409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] PATH_INFO: `/v3/projects/ee74f205ced040aa9bc73d00ea62e88b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:05.515586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee74f205ced040aa9bc73d00ea62e88b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:05.517731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:05.528687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:05.564393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee74f205ced040aa9bc73d00ea62e88b', 'request_id': 'req-a5329e66-50c4-43ae-9a6e-026e65ef39c2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.569917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee74f205ced040aa9bc73d00ea62e88b', 'request_id': 'req-a5329e66-50c4-43ae-9a6e-026e65ef39c2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.575940 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee74f205ced040aa9bc73d00ea62e88b', 'request_id': 'req-a5329e66-50c4-43ae-9a6e-026e65ef39c2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.588307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] The token cache is being invalidate because project ee74f205ced040aa9bc73d00ea62e88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:05.588589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.589240 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.590680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1096/2192] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:05 2022] DELETE /identity/v3/projects/ee74f205ced040aa9bc73d00ea62e88b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:05.594668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bb63d-5068-412b-8bab-c44bc1400690 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:05.605435 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bb63d-5068-412b-8bab-c44bc1400690 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:05.661839 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:05.662466 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:05.662739 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:05.663010 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] PATH_INFO: `/v3/users/618eae4a54f9434798f8f4bdc19dced3` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:05.664118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=618eae4a54f9434798f8f4bdc19dced3)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:05.666125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:05.712677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618eae4a54f9434798f8f4bdc19dced3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.719237 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618eae4a54f9434798f8f4bdc19dced3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.719922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618eae4a54f9434798f8f4bdc19dced3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.732253 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618eae4a54f9434798f8f4bdc19dced3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.739005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-c7fa7157-7ee7-49d2-a948-8a17e7566913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618eae4a54f9434798f8f4bdc19dced3'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:05.744719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1097/2193] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:05 2022] DELETE /identity/v3/users/618eae4a54f9434798f8f4bdc19dced3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:06.024884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.026331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:06.048771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5329e66-50c4-43ae-9a6e-026e65ef39c2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.121635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.122345 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.122687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.123022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] PATH_INFO: `/v3/projects/088eff4209964199913744ca4f05d5b6` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.124268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=088eff4209964199913744ca4f05d5b6)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.126682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.176944 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088eff4209964199913744ca4f05d5b6', 'request_id': 'req-36504f6b-87a4-4277-9520-1187aba8fb54'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:06.182827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088eff4209964199913744ca4f05d5b6', 'request_id': 'req-36504f6b-87a4-4277-9520-1187aba8fb54'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:06.189483 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088eff4209964199913744ca4f05d5b6', 'request_id': 'req-36504f6b-87a4-4277-9520-1187aba8fb54'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:06.204780 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] The token cache is being invalidate because project 088eff4209964199913744ca4f05d5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:06.205102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:06.205735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:06.207224 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1097/2194] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:06 2022] DELETE /identity/v3/projects/088eff4209964199913744ca4f05d5b6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:06.212257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540aec7-4d9d-4e2c-bf92-201dd77a8858 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.212725 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540aec7-4d9d-4e2c-bf92-201dd77a8858 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.212847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540aec7-4d9d-4e2c-bf92-201dd77a8858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.232841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1540aec7-4d9d-4e2c-bf92-201dd77a8858 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:06.233985 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1540aec7-4d9d-4e2c-bf92-201dd77a8858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:06.270628 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.272108 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:06.279255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:06.299937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1098/2195] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:06.307831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4f5d2-cb9f-4b4d-9c51-adeee4d0090c None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.308120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4f5d2-cb9f-4b4d-9c51-adeee4d0090c None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.308396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4f5d2-cb9f-4b4d-9c51-adeee4d0090c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.311079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:06.329431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0af4f5d2-cb9f-4b4d-9c51-adeee4d0090c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:06.331052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0af4f5d2-cb9f-4b4d-9c51-adeee4d0090c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:06.339187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1099/2196] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:06.343474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4f5d2-cb9f-4b4d-9c51-adeee4d0090c None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.350104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36504f6b-87a4-4277-9520-1187aba8fb54 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.354052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4f5d2-cb9f-4b4d-9c51-adeee4d0090c None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.354814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.355471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.355708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.355980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] PATH_INFO: `/v3/users/3f99fd14ce9943d5a1db606c0320bb40` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.357137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f99fd14ce9943d5a1db606c0320bb40)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.358861 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dd681-9df4-4815-87f7-c87537cc4994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.359050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.359431 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dd681-9df4-4815-87f7-c87537cc4994 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.359704 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dd681-9df4-4815-87f7-c87537cc4994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.359999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dd681-9df4-4815-87f7-c87537cc4994 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.361239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973dd681-9df4-4815-87f7-c87537cc4994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:06.361561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973dd681-9df4-4815-87f7-c87537cc4994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.363119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973dd681-9df4-4815-87f7-c87537cc4994 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.376780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1100/2197] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:33:06.381239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dd681-9df4-4815-87f7-c87537cc4994 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.391245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dd681-9df4-4815-87f7-c87537cc4994 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.396470 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8568794-b3d3-4f59-a875-42273496e8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.397498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8568794-b3d3-4f59-a875-42273496e8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.397962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8568794-b3d3-4f59-a875-42273496e8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.398349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8568794-b3d3-4f59-a875-42273496e8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.399117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8568794-b3d3-4f59-a875-42273496e8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.401483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8568794-b3d3-4f59-a875-42273496e8f6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.414035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f99fd14ce9943d5a1db606c0320bb40'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:06.414742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f99fd14ce9943d5a1db606c0320bb40'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:06.422566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f99fd14ce9943d5a1db606c0320bb40'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:06.423857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f99fd14ce9943d5a1db606c0320bb40'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:06.430396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1101/2198] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:06 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:33:06.434405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8568794-b3d3-4f59-a875-42273496e8f6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.435995 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a8568794-b3d3-4f59-a875-42273496e8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:06.436785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-abcb65b1-ded6-4954-b59d-6243bd33d906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f99fd14ce9943d5a1db606c0320bb40'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:06.451450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1098/2199] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:06 2022] DELETE /identity/v3/users/3f99fd14ce9943d5a1db606c0320bb40 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:06.456017 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a029f8-1a91-4eb1-8113-76a0bf56a5da None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.456296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a029f8-1a91-4eb1-8113-76a0bf56a5da None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.456600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a029f8-1a91-4eb1-8113-76a0bf56a5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.476960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e2a029f8-1a91-4eb1-8113-76a0bf56a5da None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:06.478201 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e2a029f8-1a91-4eb1-8113-76a0bf56a5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:06.505133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8568794-b3d3-4f59-a875-42273496e8f6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.540860 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1099/2200] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:06.551424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a029f8-1a91-4eb1-8113-76a0bf56a5da None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.552810 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e2a029f8-1a91-4eb1-8113-76a0bf56a5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:06.561618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de042e4-d0fc-463e-abdb-ab21cb8673a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.562227 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de042e4-d0fc-463e-abdb-ab21cb8673a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.562504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de042e4-d0fc-463e-abdb-ab21cb8673a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.562775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de042e4-d0fc-463e-abdb-ab21cb8673a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.563405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de042e4-d0fc-463e-abdb-ab21cb8673a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.566278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de042e4-d0fc-463e-abdb-ab21cb8673a6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.589652 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1102/2201] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:06 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:33:06.593480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de042e4-d0fc-463e-abdb-ab21cb8673a6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.603509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de042e4-d0fc-463e-abdb-ab21cb8673a6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.608072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ff204-8c14-4b95-8a11-0c29163f877c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.608448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:06.608657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ff204-8c14-4b95-8a11-0c29163f877c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.608935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ff204-8c14-4b95-8a11-0c29163f877c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.609247 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ff204-8c14-4b95-8a11-0c29163f877c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.609909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ff204-8c14-4b95-8a11-0c29163f877c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.611652 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ff204-8c14-4b95-8a11-0c29163f877c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.612478 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a029f8-1a91-4eb1-8113-76a0bf56a5da None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.617697 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7664b-9127-443e-9bdc-20f1d672b669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.619014 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7664b-9127-443e-9bdc-20f1d672b669 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.619296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7664b-9127-443e-9bdc-20f1d672b669 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.619584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7664b-9127-443e-9bdc-20f1d672b669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.621781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1103/2202] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:06.625669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ff204-8c14-4b95-8a11-0c29163f877c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.630357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7664b-9127-443e-9bdc-20f1d672b669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.631823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7664b-9127-443e-9bdc-20f1d672b669 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.635833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ff204-8c14-4b95-8a11-0c29163f877c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.640377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ea350-8308-4aca-bcad-0f4a29a24512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.640948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ea350-8308-4aca-bcad-0f4a29a24512 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.641255 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ea350-8308-4aca-bcad-0f4a29a24512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.641375 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1100/2203] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:33:06.641522 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ea350-8308-4aca-bcad-0f4a29a24512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.642716 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ea350-8308-4aca-bcad-0f4a29a24512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.644306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ea350-8308-4aca-bcad-0f4a29a24512 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.655109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1104/2204] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:06.659276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7664b-9127-443e-9bdc-20f1d672b669 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.669720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7664b-9127-443e-9bdc-20f1d672b669 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.674758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8951f7-ac60-4fef-a15b-baea1d2bdf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.675437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8951f7-ac60-4fef-a15b-baea1d2bdf64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.675715 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8951f7-ac60-4fef-a15b-baea1d2bdf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.675979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8951f7-ac60-4fef-a15b-baea1d2bdf64 admin admin] PATH_INFO: `/v3/projects/3f266b15b7a341108845d845e151bb06/users/44e5d71a328e4d47b5432e772c3a5537/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.693638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8951f7-ac60-4fef-a15b-baea1d2bdf64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f266b15b7a341108845d845e151bb06, user_id=44e5d71a328e4d47b5432e772c3a5537, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.696830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8951f7-ac60-4fef-a15b-baea1d2bdf64 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.711057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1101/2205] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:06 2022] PUT /identity/v3/projects/3f266b15b7a341108845d845e151bb06/users/44e5d71a328e4d47b5432e772c3a5537/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:06.723078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b287f4-427c-46a0-9f1f-fcd3d404ab79 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.723389 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b287f4-427c-46a0-9f1f-fcd3d404ab79 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.723639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b287f4-427c-46a0-9f1f-fcd3d404ab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.761171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-90b287f4-427c-46a0-9f1f-fcd3d404ab79 None None] MFA Rules not processed for user `44e5d71a328e4d47b5432e772c3a5537`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:06.762314 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-90b287f4-427c-46a0-9f1f-fcd3d404ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:06.772294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:06.840879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1105/2206] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:06.846067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8951f7-ac60-4fef-a15b-baea1d2bdf64 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.919639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8951f7-ac60-4fef-a15b-baea1d2bdf64 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.925116 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087a42-1daa-41e2-83ec-a3767a557b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.925720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087a42-1daa-41e2-83ec-a3767a557b43 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.925991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087a42-1daa-41e2-83ec-a3767a557b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.926258 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087a42-1daa-41e2-83ec-a3767a557b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.926897 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9087a42-1daa-41e2-83ec-a3767a557b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.928819 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9087a42-1daa-41e2-83ec-a3767a557b43 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.930374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b287f4-427c-46a0-9f1f-fcd3d404ab79 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:06.931881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-90b287f4-427c-46a0-9f1f-fcd3d404ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:06.947808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b287f4-427c-46a0-9f1f-fcd3d404ab79 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:06.952659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:06.953370 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:06.953603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:06.953875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] PATH_INFO: `/v3/projects/20fdc717e23242f19d4c3386d5fe3a2b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:06.955657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fdc717e23242f19d4c3386d5fe3a2b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:06.957879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:06.967424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1102/2207] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:06 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:06.968812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087a42-1daa-41e2-83ec-a3767a557b43 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.008069 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fdc717e23242f19d4c3386d5fe3a2b', 'request_id': 'req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.016270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fdc717e23242f19d4c3386d5fe3a2b', 'request_id': 'req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.022746 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fdc717e23242f19d4c3386d5fe3a2b', 'request_id': 'req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.034497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] The token cache is being invalidate because project 20fdc717e23242f19d4c3386d5fe3a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:07.034802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.035451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.035712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087a42-1daa-41e2-83ec-a3767a557b43 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.036959 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1106/2208] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:06 2022] DELETE /identity/v3/projects/20fdc717e23242f19d4c3386d5fe3a2b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:07.041509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.042974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.094250 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9969d-f803-4f3b-9c5b-a5ded0cfdf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.094960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9969d-f803-4f3b-9c5b-a5ded0cfdf58 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.095237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9969d-f803-4f3b-9c5b-a5ded0cfdf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.095781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9969d-f803-4f3b-9c5b-a5ded0cfdf58 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.096519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9969d-f803-4f3b-9c5b-a5ded0cfdf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.098732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9969d-f803-4f3b-9c5b-a5ded0cfdf58 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:07.106744 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:07.107027 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d2a2-9bf3-416c-950c-d0fdbaa11584 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.113644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.114444 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.114877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.115863 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] PATH_INFO: `/v3/users/e83d37f2383f451397ab206acde1200f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.117785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83d37f2383f451397ab206acde1200f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.119734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:07.122133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1103/2209] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:06 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:33:07.125952 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9969d-f803-4f3b-9c5b-a5ded0cfdf58 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.127876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3fd9969d-f803-4f3b-9c5b-a5ded0cfdf58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.139803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9969d-f803-4f3b-9c5b-a5ded0cfdf58 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.145626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f21e5-6ae9-4a79-a0a8-334babf8f8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.146283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f21e5-6ae9-4a79-a0a8-334babf8f8bf admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.146571 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f21e5-6ae9-4a79-a0a8-334babf8f8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.146916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f21e5-6ae9-4a79-a0a8-334babf8f8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.147567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f21e5-6ae9-4a79-a0a8-334babf8f8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.149311 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f21e5-6ae9-4a79-a0a8-334babf8f8bf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:07.162461 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1104/2210] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:07.162802 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:07.167960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f21e5-6ae9-4a79-a0a8-334babf8f8bf admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.174139 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83d37f2383f451397ab206acde1200f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.178066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f21e5-6ae9-4a79-a0a8-334babf8f8bf admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.182158 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83d37f2383f451397ab206acde1200f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.182767 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83d37f2383f451397ab206acde1200f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.183388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae68771-e0a7-4d9a-a8e6-05eb5b95ca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.184132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae68771-e0a7-4d9a-a8e6-05eb5b95ca3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.184546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae68771-e0a7-4d9a-a8e6-05eb5b95ca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.184922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae68771-e0a7-4d9a-a8e6-05eb5b95ca3f admin admin] PATH_INFO: `/v3/projects/532a087a680f4c34a7435167dab505d0/users/11e91570372d469f9ba45a6b29a6ecdd/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.195287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83d37f2383f451397ab206acde1200f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.201063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae68771-e0a7-4d9a-a8e6-05eb5b95ca3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=532a087a680f4c34a7435167dab505d0, user_id=11e91570372d469f9ba45a6b29a6ecdd, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.202480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83d37f2383f451397ab206acde1200f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.203702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae68771-e0a7-4d9a-a8e6-05eb5b95ca3f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:07.209032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1107/2211] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:07 2022] DELETE /identity/v3/users/e83d37f2383f451397ab206acde1200f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:07.218419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1105/2212] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:07 2022] PUT /identity/v3/projects/532a087a680f4c34a7435167dab505d0/users/11e91570372d469f9ba45a6b29a6ecdd/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:07.223292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.225053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.297566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0638c-b23d-41a7-a912-1a0fc24b8152 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.356079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c94de3-2f7a-4c57-8cde-f4b17b1d8498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.356685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c94de3-2f7a-4c57-8cde-f4b17b1d8498 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.356964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c94de3-2f7a-4c57-8cde-f4b17b1d8498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.357291 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c94de3-2f7a-4c57-8cde-f4b17b1d8498 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.357920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c94de3-2f7a-4c57-8cde-f4b17b1d8498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.359535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c94de3-2f7a-4c57-8cde-f4b17b1d8498 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:07.376542 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1108/2213] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:07.378258 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae68771-e0a7-4d9a-a8e6-05eb5b95ca3f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.388682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae68771-e0a7-4d9a-a8e6-05eb5b95ca3f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.393537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189897c-fa8c-456e-95dc-8ff2e175fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.394287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189897c-fa8c-456e-95dc-8ff2e175fdea admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.394634 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189897c-fa8c-456e-95dc-8ff2e175fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.394978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189897c-fa8c-456e-95dc-8ff2e175fdea admin admin] PATH_INFO: `/v3/projects/532a087a680f4c34a7435167dab505d0/users/11e91570372d469f9ba45a6b29a6ecdd/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.397049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189897c-fa8c-456e-95dc-8ff2e175fdea admin admin] RBAC: Authorizing `identity:create_grant(project_id=532a087a680f4c34a7435167dab505d0, user_id=11e91570372d469f9ba45a6b29a6ecdd, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.399775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189897c-fa8c-456e-95dc-8ff2e175fdea admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:07.411131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1106/2214] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:07 2022] PUT /identity/v3/projects/532a087a680f4c34a7435167dab505d0/users/11e91570372d469f9ba45a6b29a6ecdd/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:07.422420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa87d34-29be-4ab9-8cd3-1aa85f2b6047 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.422828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa87d34-29be-4ab9-8cd3-1aa85f2b6047 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.423247 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa87d34-29be-4ab9-8cd3-1aa85f2b6047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.451517 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-3fa87d34-29be-4ab9-8cd3-1aa85f2b6047 None None] MFA Rules not processed for user `11e91570372d469f9ba45a6b29a6ecdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:07.452724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3fa87d34-29be-4ab9-8cd3-1aa85f2b6047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.493463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189897c-fa8c-456e-95dc-8ff2e175fdea admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.495460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1189897c-fa8c-456e-95dc-8ff2e175fdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.502963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:07.534791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1109/2215] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:07.544705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa87d34-29be-4ab9-8cd3-1aa85f2b6047 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.546090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3fa87d34-29be-4ab9-8cd3-1aa85f2b6047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.583057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189897c-fa8c-456e-95dc-8ff2e175fdea admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.587767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.588390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.588666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.588935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] PATH_INFO: `/v3/projects/be84f75a10ee401bafe9d0ec099e25b2` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.590100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be84f75a10ee401bafe9d0ec099e25b2)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.591994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:07.605233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa87d34-29be-4ab9-8cd3-1aa85f2b6047 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.609333 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541716b-1d6d-4ced-bf06-74195446a1b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.610009 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541716b-1d6d-4ced-bf06-74195446a1b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.610881 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541716b-1d6d-4ced-bf06-74195446a1b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.611309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541716b-1d6d-4ced-bf06-74195446a1b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.613323 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1541716b-1d6d-4ced-bf06-74195446a1b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.642995 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be84f75a10ee401bafe9d0ec099e25b2', 'request_id': 'req-20660896-8428-4aec-a42d-c9abebcd1fa2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.648543 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be84f75a10ee401bafe9d0ec099e25b2', 'request_id': 'req-20660896-8428-4aec-a42d-c9abebcd1fa2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.655172 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be84f75a10ee401bafe9d0ec099e25b2', 'request_id': 'req-20660896-8428-4aec-a42d-c9abebcd1fa2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.679752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] The token cache is being invalidate because project be84f75a10ee401bafe9d0ec099e25b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:07.680276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.681344 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-20660896-8428-4aec-a42d-c9abebcd1fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:07.686770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1107/2216] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:07 2022] DELETE /identity/v3/projects/be84f75a10ee401bafe9d0ec099e25b2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:07.686939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541716b-1d6d-4ced-bf06-74195446a1b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.686939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541716b-1d6d-4ced-bf06-74195446a1b0 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:07.688214 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964e839-139b-4598-b1f7-1088a474fe1f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.688495 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964e839-139b-4598-b1f7-1088a474fe1f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.689534 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964e839-139b-4598-b1f7-1088a474fe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.695874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1110/2217] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:33:07.709932 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0964e839-139b-4598-b1f7-1088a474fe1f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:07.711129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0964e839-139b-4598-b1f7-1088a474fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.737912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:07.775071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1108/2218] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:07.784019 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01348c3-cc43-45db-923b-38d31c6eb4c4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.784300 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01348c3-cc43-45db-923b-38d31c6eb4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.784573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01348c3-cc43-45db-923b-38d31c6eb4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.804886 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e01348c3-cc43-45db-923b-38d31c6eb4c4 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:07.806125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e01348c3-cc43-45db-923b-38d31c6eb4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:07.814790 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1111/2219] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:07.819095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964e839-139b-4598-b1f7-1088a474fe1f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.829080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964e839-139b-4598-b1f7-1088a474fe1f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.834140 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100fa81-6bad-4b0e-aef2-b711db77db9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.834698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100fa81-6bad-4b0e-aef2-b711db77db9c admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.835027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100fa81-6bad-4b0e-aef2-b711db77db9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.835315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100fa81-6bad-4b0e-aef2-b711db77db9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.835950 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100fa81-6bad-4b0e-aef2-b711db77db9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:07.836257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100fa81-6bad-4b0e-aef2-b711db77db9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.837967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100fa81-6bad-4b0e-aef2-b711db77db9c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:07.851739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1109/2220] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:33:07.856459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01348c3-cc43-45db-923b-38d31c6eb4c4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.866498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01348c3-cc43-45db-923b-38d31c6eb4c4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.871291 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985d160-c7c2-4454-81e8-6dbbe97515aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.871886 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985d160-c7c2-4454-81e8-6dbbe97515aa admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.872162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985d160-c7c2-4454-81e8-6dbbe97515aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.872430 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985d160-c7c2-4454-81e8-6dbbe97515aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.873094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985d160-c7c2-4454-81e8-6dbbe97515aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.875050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985d160-c7c2-4454-81e8-6dbbe97515aa admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:07.912636 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1112/2221] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:07 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:07.917340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100fa81-6bad-4b0e-aef2-b711db77db9c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:07.928646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100fa81-6bad-4b0e-aef2-b711db77db9c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:07.993128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a72a1-6255-4849-a952-0a734d330801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:07.993876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a72a1-6255-4849-a952-0a734d330801 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:07.994004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a72a1-6255-4849-a952-0a734d330801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:07.994254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a72a1-6255-4849-a952-0a734d330801 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:07.994890 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a72a1-6255-4849-a952-0a734d330801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:07.997117 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a72a1-6255-4849-a952-0a734d330801 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.023263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1110/2222] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:07 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:08.024626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985d160-c7c2-4454-81e8-6dbbe97515aa admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.037485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985d160-c7c2-4454-81e8-6dbbe97515aa admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.042138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927930e5-c827-401e-8ae7-a413a89e804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.042734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927930e5-c827-401e-8ae7-a413a89e804a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.043007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927930e5-c827-401e-8ae7-a413a89e804a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.043271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927930e5-c827-401e-8ae7-a413a89e804a admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.043902 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927930e5-c827-401e-8ae7-a413a89e804a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.045516 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927930e5-c827-401e-8ae7-a413a89e804a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.056120 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1113/2223] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:08.060256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a72a1-6255-4849-a952-0a734d330801 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.070804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a72a1-6255-4849-a952-0a734d330801 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.075352 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4392d-93ee-44e1-b418-14e92ce19240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.075930 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4392d-93ee-44e1-b418-14e92ce19240 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.076202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4392d-93ee-44e1-b418-14e92ce19240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.076471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4392d-93ee-44e1-b418-14e92ce19240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.077128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4392d-93ee-44e1-b418-14e92ce19240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.078704 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4392d-93ee-44e1-b418-14e92ce19240 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.090739 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1111/2224] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:08.094729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927930e5-c827-401e-8ae7-a413a89e804a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.105395 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927930e5-c827-401e-8ae7-a413a89e804a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.110145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e365d1-b260-4d41-8640-2bb8194c0ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.111022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e365d1-b260-4d41-8640-2bb8194c0ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.111296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e365d1-b260-4d41-8640-2bb8194c0ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.111565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e365d1-b260-4d41-8640-2bb8194c0ba1 admin admin] PATH_INFO: `/v3/projects/62c0c139f0b842938cadbd790440657c/users/4ddc9b23504c40a4a686b081bcaa47fb/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.125905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e365d1-b260-4d41-8640-2bb8194c0ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c0c139f0b842938cadbd790440657c, user_id=4ddc9b23504c40a4a686b081bcaa47fb, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.129290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e365d1-b260-4d41-8640-2bb8194c0ba1 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.142864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1114/2225] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:08 2022] PUT /identity/v3/projects/62c0c139f0b842938cadbd790440657c/users/4ddc9b23504c40a4a686b081bcaa47fb/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:08.153348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ea0ba-4a58-4796-b4e3-11669ed33b02 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.153823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ea0ba-4a58-4796-b4e3-11669ed33b02 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.153930 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ea0ba-4a58-4796-b4e3-11669ed33b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.181849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-145ea0ba-4a58-4796-b4e3-11669ed33b02 None None] MFA Rules not processed for user `4ddc9b23504c40a4a686b081bcaa47fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:08.183044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-145ea0ba-4a58-4796-b4e3-11669ed33b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:08.249085 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1112/2226] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:08.254051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e365d1-b260-4d41-8640-2bb8194c0ba1 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.287106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:08.317657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e365d1-b260-4d41-8640-2bb8194c0ba1 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.322298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362ef61-bd34-4a4b-a6dd-728bf7a6c9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.322889 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362ef61-bd34-4a4b-a6dd-728bf7a6c9cb admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.323160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362ef61-bd34-4a4b-a6dd-728bf7a6c9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.323663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362ef61-bd34-4a4b-a6dd-728bf7a6c9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.324305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362ef61-bd34-4a4b-a6dd-728bf7a6c9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.326219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362ef61-bd34-4a4b-a6dd-728bf7a6c9cb admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.351906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1115/2227] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:08 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:08.355915 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ea0ba-4a58-4796-b4e3-11669ed33b02 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.367526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ea0ba-4a58-4796-b4e3-11669ed33b02 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.392756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:08.426029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d69a2-ea43-4c66-b159-7519901968ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.426635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d69a2-ea43-4c66-b159-7519901968ae admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.426913 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d69a2-ea43-4c66-b159-7519901968ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.427185 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d69a2-ea43-4c66-b159-7519901968ae admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.427807 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d69a2-ea43-4c66-b159-7519901968ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.429775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d69a2-ea43-4c66-b159-7519901968ae admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.451051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1113/2228] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:08 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:08.455624 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362ef61-bd34-4a4b-a6dd-728bf7a6c9cb admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.465829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362ef61-bd34-4a4b-a6dd-728bf7a6c9cb admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.471354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3526d-4f6c-4266-9f7f-20df6d29c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.471952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3526d-4f6c-4266-9f7f-20df6d29c330 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.472231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3526d-4f6c-4266-9f7f-20df6d29c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.472502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3526d-4f6c-4266-9f7f-20df6d29c330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.473443 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3526d-4f6c-4266-9f7f-20df6d29c330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.475030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3526d-4f6c-4266-9f7f-20df6d29c330 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.485610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1116/2229] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:08.489859 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d69a2-ea43-4c66-b159-7519901968ae admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.499996 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d69a2-ea43-4c66-b159-7519901968ae admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.504762 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034e24-558f-4728-843e-6158d40dd031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.505428 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034e24-558f-4728-843e-6158d40dd031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.505729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034e24-558f-4728-843e-6158d40dd031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.506000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034e24-558f-4728-843e-6158d40dd031 admin admin] PATH_INFO: `/v3/projects/6c412ee01ae2463f8f03865515f0f11f/users/76887dd9451f4868bb726a3e1002a075/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.520883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034e24-558f-4728-843e-6158d40dd031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c412ee01ae2463f8f03865515f0f11f, user_id=76887dd9451f4868bb726a3e1002a075, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.523523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034e24-558f-4728-843e-6158d40dd031 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.536053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1114/2230] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:08 2022] PUT /identity/v3/projects/6c412ee01ae2463f8f03865515f0f11f/users/76887dd9451f4868bb726a3e1002a075/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:08.539905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3526d-4f6c-4266-9f7f-20df6d29c330 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.550271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3526d-4f6c-4266-9f7f-20df6d29c330 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.605309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f93f1-4a2f-460e-b3b8-e005d7507872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.605825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f93f1-4a2f-460e-b3b8-e005d7507872 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.606097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f93f1-4a2f-460e-b3b8-e005d7507872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.606364 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f93f1-4a2f-460e-b3b8-e005d7507872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.607334 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f93f1-4a2f-460e-b3b8-e005d7507872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.609174 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f93f1-4a2f-460e-b3b8-e005d7507872 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.619811 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1117/2231] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:08.623975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034e24-558f-4728-843e-6158d40dd031 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.634895 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034e24-558f-4728-843e-6158d40dd031 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.639480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4756ae-6bd0-4195-886f-d814683cd8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.640119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4756ae-6bd0-4195-886f-d814683cd8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.640396 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4756ae-6bd0-4195-886f-d814683cd8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.640665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4756ae-6bd0-4195-886f-d814683cd8ec admin admin] PATH_INFO: `/v3/projects/6c412ee01ae2463f8f03865515f0f11f/users/76887dd9451f4868bb726a3e1002a075/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.642706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4756ae-6bd0-4195-886f-d814683cd8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c412ee01ae2463f8f03865515f0f11f, user_id=76887dd9451f4868bb726a3e1002a075, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.645369 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4756ae-6bd0-4195-886f-d814683cd8ec admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.655680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1115/2232] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:08 2022] PUT /identity/v3/projects/6c412ee01ae2463f8f03865515f0f11f/users/76887dd9451f4868bb726a3e1002a075/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:08.666580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17826f-c406-4cc4-a739-0219e2e1d685 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.667122 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17826f-c406-4cc4-a739-0219e2e1d685 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.667291 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17826f-c406-4cc4-a739-0219e2e1d685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.695412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ab17826f-c406-4cc4-a739-0219e2e1d685 None None] MFA Rules not processed for user `76887dd9451f4868bb726a3e1002a075`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:08.696607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ab17826f-c406-4cc4-a739-0219e2e1d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:08.762903 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1118/2233] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:08.774367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4756ae-6bd0-4195-886f-d814683cd8ec admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.776060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2e4756ae-6bd0-4195-886f-d814683cd8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:08.833646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4756ae-6bd0-4195-886f-d814683cd8ec admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.837272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d3e4f-7210-4f97-b6e9-a95a64fdea7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.837864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d3e4f-7210-4f97-b6e9-a95a64fdea7b service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.838138 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d3e4f-7210-4f97-b6e9-a95a64fdea7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.838406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d3e4f-7210-4f97-b6e9-a95a64fdea7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.848196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d3e4f-7210-4f97-b6e9-a95a64fdea7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.849656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d3e4f-7210-4f97-b6e9-a95a64fdea7b service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:08.858971 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1116/2234] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:08.926089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17826f-c406-4cc4-a739-0219e2e1d685 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:08.954935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:08.989039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17826f-c406-4cc4-a739-0219e2e1d685 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:08.993584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:08.994202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:08.994474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:08.994745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] PATH_INFO: `/v3/users/4ddc9b23504c40a4a686b081bcaa47fb` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:08.995863 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddc9b23504c40a4a686b081bcaa47fb)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:08.997811 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:09.046357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddc9b23504c40a4a686b081bcaa47fb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.055977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddc9b23504c40a4a686b081bcaa47fb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.056750 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddc9b23504c40a4a686b081bcaa47fb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.069274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddc9b23504c40a4a686b081bcaa47fb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.078064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddc9b23504c40a4a686b081bcaa47fb'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.086160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1119/2235] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:08 2022] DELETE /identity/v3/users/4ddc9b23504c40a4a686b081bcaa47fb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:09.090594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304e004-75f0-4abb-acb2-185852b67a66 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:09.091121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304e004-75f0-4abb-acb2-185852b67a66 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:09.091394 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304e004-75f0-4abb-acb2-185852b67a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:09.113688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2304e004-75f0-4abb-acb2-185852b67a66 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:09.114863 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2304e004-75f0-4abb-acb2-185852b67a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:09.182118 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1117/2236] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:09.192167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:09.193607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:09.259795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb6f3d-51a5-46e6-a16a-17f8a3ef575f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:09.263579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ea0f9-51b5-4383-a28a-9e52db1673c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:09.264173 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ea0f9-51b5-4383-a28a-9e52db1673c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:09.264446 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ea0f9-51b5-4383-a28a-9e52db1673c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:09.264709 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ea0f9-51b5-4383-a28a-9e52db1673c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:09.274937 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ea0f9-51b5-4383-a28a-9e52db1673c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:09.276451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ea0f9-51b5-4383-a28a-9e52db1673c9 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:09.286927 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1120/2237] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:09.559918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304e004-75f0-4abb-acb2-185852b67a66 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:09.561481 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2304e004-75f0-4abb-acb2-185852b67a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:09.575034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304e004-75f0-4abb-acb2-185852b67a66 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:09.580298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:09.581475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:09.581475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:09.581708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] PATH_INFO: `/v3/projects/62c0c139f0b842938cadbd790440657c` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:09.582848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c0c139f0b842938cadbd790440657c)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:09.584730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:09.601901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:09.631761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c0c139f0b842938cadbd790440657c', 'request_id': 'req-e876b884-4861-406b-b556-f5b8394e3367'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.637417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c0c139f0b842938cadbd790440657c', 'request_id': 'req-e876b884-4861-406b-b556-f5b8394e3367'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.644533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c0c139f0b842938cadbd790440657c', 'request_id': 'req-e876b884-4861-406b-b556-f5b8394e3367'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.656497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] The token cache is being invalidate because project 62c0c139f0b842938cadbd790440657c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:09.656780 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.657665 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.659173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1118/2238] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:09 2022] DELETE /identity/v3/projects/62c0c139f0b842938cadbd790440657c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:09.663123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ea0f9-51b5-4383-a28a-9e52db1673c9 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:09.673885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ea0f9-51b5-4383-a28a-9e52db1673c9 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:09.718418 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:09.731476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:09.732092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:09.732364 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:09.732630 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] PATH_INFO: `/v3/users/76887dd9451f4868bb726a3e1002a075` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:09.733752 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76887dd9451f4868bb726a3e1002a075)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:09.735668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:09.780079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76887dd9451f4868bb726a3e1002a075'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.787552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76887dd9451f4868bb726a3e1002a075'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.788440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76887dd9451f4868bb726a3e1002a075'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.801571 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76887dd9451f4868bb726a3e1002a075'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.808507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-77fd2e84-7f8f-48d8-ae98-d13adc752970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76887dd9451f4868bb726a3e1002a075'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:09.815032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1121/2239] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:09 2022] DELETE /identity/v3/users/76887dd9451f4868bb726a3e1002a075 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:10.084269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:10.085717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:10.102594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876b884-4861-406b-b556-f5b8394e3367 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:10.165657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:10.166200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.166474 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.166743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] PATH_INFO: `/v3/projects/6c412ee01ae2463f8f03865515f0f11f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.167851 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c412ee01ae2463f8f03865515f0f11f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:10.169761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:10.215215 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c412ee01ae2463f8f03865515f0f11f', 'request_id': 'req-9ca88636-a779-4f92-a5c9-c397926b9da4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:10.221307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c412ee01ae2463f8f03865515f0f11f', 'request_id': 'req-9ca88636-a779-4f92-a5c9-c397926b9da4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:10.227633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c412ee01ae2463f8f03865515f0f11f', 'request_id': 'req-9ca88636-a779-4f92-a5c9-c397926b9da4'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:10.240452 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] The token cache is being invalidate because project 6c412ee01ae2463f8f03865515f0f11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:10.240741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:10.241410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:10.242869 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1119/2240] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:10 2022] DELETE /identity/v3/projects/6c412ee01ae2463f8f03865515f0f11f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:10.247755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ab827-5f77-48a5-b0bb-036dce85be87 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.248034 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ab827-5f77-48a5-b0bb-036dce85be87 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.248310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ab827-5f77-48a5-b0bb-036dce85be87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.270123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-856ab827-5f77-48a5-b0bb-036dce85be87 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:10.271359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-856ab827-5f77-48a5-b0bb-036dce85be87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:10.290614 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:10.291990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:10.333972 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1122/2241] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:10.336410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:10.342678 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995df45-39cc-414d-a208-adb3ed54caee None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.342884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995df45-39cc-414d-a208-adb3ed54caee None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.343157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995df45-39cc-414d-a208-adb3ed54caee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.357417 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca88636-a779-4f92-a5c9-c397926b9da4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:10.362383 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e44991-0643-4b60-98ec-b7cdcdbeb844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:10.362986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e44991-0643-4b60-98ec-b7cdcdbeb844 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.363264 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e44991-0643-4b60-98ec-b7cdcdbeb844 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.363532 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e44991-0643-4b60-98ec-b7cdcdbeb844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.364364 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6995df45-39cc-414d-a208-adb3ed54caee None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:10.365391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-80e44991-0643-4b60-98ec-b7cdcdbeb844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:10.365614 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6995df45-39cc-414d-a208-adb3ed54caee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:10.374876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1123/2242] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:10.378562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995df45-39cc-414d-a208-adb3ed54caee None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:10.387590 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995df45-39cc-414d-a208-adb3ed54caee None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:10.392135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0834a67-ee85-47f7-95a8-75040903046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:10.392712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0834a67-ee85-47f7-95a8-75040903046e admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.392978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0834a67-ee85-47f7-95a8-75040903046e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.393326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0834a67-ee85-47f7-95a8-75040903046e admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.393963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0834a67-ee85-47f7-95a8-75040903046e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:10.394261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0834a67-ee85-47f7-95a8-75040903046e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:10.395821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0834a67-ee85-47f7-95a8-75040903046e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:10.407075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1124/2243] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:33:10.411934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0834a67-ee85-47f7-95a8-75040903046e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:10.422123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0834a67-ee85-47f7-95a8-75040903046e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:10.428315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da0a91-2682-46e3-b3f0-2d147c09cd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:10.428898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da0a91-2682-46e3-b3f0-2d147c09cd42 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.429208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da0a91-2682-46e3-b3f0-2d147c09cd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.429523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da0a91-2682-46e3-b3f0-2d147c09cd42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.430130 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da0a91-2682-46e3-b3f0-2d147c09cd42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:10.431511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e44991-0643-4b60-98ec-b7cdcdbeb844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:10.432012 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da0a91-2682-46e3-b3f0-2d147c09cd42 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:10.432937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e44991-0643-4b60-98ec-b7cdcdbeb844 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:10.443541 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1120/2244] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:33:10.460093 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1125/2245] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:10 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:33:10.464289 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e44991-0643-4b60-98ec-b7cdcdbeb844 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:10.476326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e44991-0643-4b60-98ec-b7cdcdbeb844 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:10.536579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5252c9-7619-4777-a6f2-f581aef0a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:10.536579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5252c9-7619-4777-a6f2-f581aef0a215 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.537200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5252c9-7619-4777-a6f2-f581aef0a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.537507 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5252c9-7619-4777-a6f2-f581aef0a215 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.538229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5252c9-7619-4777-a6f2-f581aef0a215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:10.540049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5252c9-7619-4777-a6f2-f581aef0a215 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:10.561992 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1121/2246] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:10 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:33:10.566434 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da0a91-2682-46e3-b3f0-2d147c09cd42 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:10.576981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da0a91-2682-46e3-b3f0-2d147c09cd42 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:10.583437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9dadb-2e7c-46c3-9eff-1d3eb398745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:10.584036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9dadb-2e7c-46c3-9eff-1d3eb398745d admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.584305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9dadb-2e7c-46c3-9eff-1d3eb398745d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.584567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9dadb-2e7c-46c3-9eff-1d3eb398745d admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.585228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9dadb-2e7c-46c3-9eff-1d3eb398745d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:10.586803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9dadb-2e7c-46c3-9eff-1d3eb398745d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:10.599242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1126/2247] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:10.601114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5252c9-7619-4777-a6f2-f581aef0a215 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:10.612274 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5252c9-7619-4777-a6f2-f581aef0a215 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:10.617024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171ddcc-87ea-4ccd-a158-5d85b85da795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:10.617633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171ddcc-87ea-4ccd-a158-5d85b85da795 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.617909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171ddcc-87ea-4ccd-a158-5d85b85da795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.618181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171ddcc-87ea-4ccd-a158-5d85b85da795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.618818 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171ddcc-87ea-4ccd-a158-5d85b85da795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:10.620422 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171ddcc-87ea-4ccd-a158-5d85b85da795 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:10.632720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1122/2248] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:10.636538 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9dadb-2e7c-46c3-9eff-1d3eb398745d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:10.646689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9dadb-2e7c-46c3-9eff-1d3eb398745d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:10.651451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de33e-1603-4b48-a0bf-462babcc05d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:10.652334 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de33e-1603-4b48-a0bf-462babcc05d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.652623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de33e-1603-4b48-a0bf-462babcc05d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.652952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de33e-1603-4b48-a0bf-462babcc05d6 admin admin] PATH_INFO: `/v3/projects/f4f862be225f4692b6589e7891ec2445/users/301d30d52e3a43f1a7c4a7c9d6d772db/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.666243 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:10.671019 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79de33e-1603-4b48-a0bf-462babcc05d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f862be225f4692b6589e7891ec2445, user_id=301d30d52e3a43f1a7c4a7c9d6d772db, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:10.675235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79de33e-1603-4b48-a0bf-462babcc05d6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:10.690283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1127/2249] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:10 2022] PUT /identity/v3/projects/f4f862be225f4692b6589e7891ec2445/users/301d30d52e3a43f1a7c4a7c9d6d772db/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:10.701095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8e559-d9fb-4a31-be3d-4f382b89954a None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.701381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8e559-d9fb-4a31-be3d-4f382b89954a None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.701653 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8e559-d9fb-4a31-be3d-4f382b89954a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.731666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-84a8e559-d9fb-4a31-be3d-4f382b89954a None None] MFA Rules not processed for user `301d30d52e3a43f1a7c4a7c9d6d772db`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:10.732892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-84a8e559-d9fb-4a31-be3d-4f382b89954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:10.803768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:10.815601 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1123/2250] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:10.820634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de33e-1603-4b48-a0bf-462babcc05d6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:10.882489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de33e-1603-4b48-a0bf-462babcc05d6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:10.887172 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016acca-5b7b-4625-ae14-206ab518e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:10.887758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016acca-5b7b-4625-ae14-206ab518e1ec admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.888035 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016acca-5b7b-4625-ae14-206ab518e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.888301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016acca-5b7b-4625-ae14-206ab518e1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.888923 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016acca-5b7b-4625-ae14-206ab518e1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:10.890825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016acca-5b7b-4625-ae14-206ab518e1ec admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:10.924299 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1128/2251] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:10 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:10.929227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8e559-d9fb-4a31-be3d-4f382b89954a None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:10.942517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8e559-d9fb-4a31-be3d-4f382b89954a None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:10.998084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825e04f-4da9-462d-853a-b82947abcb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:10.998683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825e04f-4da9-462d-853a-b82947abcb70 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.998962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825e04f-4da9-462d-853a-b82947abcb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.999233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825e04f-4da9-462d-853a-b82947abcb70 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.999856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825e04f-4da9-462d-853a-b82947abcb70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.002028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825e04f-4da9-462d-853a-b82947abcb70 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.022953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1124/2252] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:10 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:11.027075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016acca-5b7b-4625-ae14-206ab518e1ec admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:11.037681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016acca-5b7b-4625-ae14-206ab518e1ec admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:11.042164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7e34d-8df0-4355-9fc1-f2824f19c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:11.042731 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e34d-8df0-4355-9fc1-f2824f19c156 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.043003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e34d-8df0-4355-9fc1-f2824f19c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.043267 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e34d-8df0-4355-9fc1-f2824f19c156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.043892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7e34d-8df0-4355-9fc1-f2824f19c156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.045508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7e34d-8df0-4355-9fc1-f2824f19c156 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.056289 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1129/2253] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:11.060102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825e04f-4da9-462d-853a-b82947abcb70 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:11.070027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825e04f-4da9-462d-853a-b82947abcb70 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:11.074609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23363f-62a2-4567-8154-d063dbada4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:11.075189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23363f-62a2-4567-8154-d063dbada4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.075462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23363f-62a2-4567-8154-d063dbada4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.075730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23363f-62a2-4567-8154-d063dbada4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.076355 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23363f-62a2-4567-8154-d063dbada4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.077958 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23363f-62a2-4567-8154-d063dbada4f5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.087741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1125/2254] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:11.091684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7e34d-8df0-4355-9fc1-f2824f19c156 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:11.102496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7e34d-8df0-4355-9fc1-f2824f19c156 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:11.106987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b27c5-969c-4c86-867c-e37a2e5dc15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:11.107612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b27c5-969c-4c86-867c-e37a2e5dc15a admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.107898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b27c5-969c-4c86-867c-e37a2e5dc15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.108148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b27c5-969c-4c86-867c-e37a2e5dc15a admin admin] PATH_INFO: `/v3/projects/ba5542ed83674d4fb9ef98cd96e9785c/users/4430616964514d3e9b7ab71a09b86664/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.124036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b27c5-969c-4c86-867c-e37a2e5dc15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5542ed83674d4fb9ef98cd96e9785c, user_id=4430616964514d3e9b7ab71a09b86664, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.126838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b27c5-969c-4c86-867c-e37a2e5dc15a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.139986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1130/2255] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:11 2022] PUT /identity/v3/projects/ba5542ed83674d4fb9ef98cd96e9785c/users/4430616964514d3e9b7ab71a09b86664/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:11.150986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9ed6-6b2b-4e44-bc78-d8e15b167718 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.151271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9ed6-6b2b-4e44-bc78-d8e15b167718 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.151545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc9ed6-6b2b-4e44-bc78-d8e15b167718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.179957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-68bc9ed6-6b2b-4e44-bc78-d8e15b167718 None None] MFA Rules not processed for user `4430616964514d3e9b7ab71a09b86664`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:11.181128 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-68bc9ed6-6b2b-4e44-bc78-d8e15b167718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:11.243816 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1126/2256] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:11.248292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b27c5-969c-4c86-867c-e37a2e5dc15a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:11.308374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b27c5-969c-4c86-867c-e37a2e5dc15a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:11.312878 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7d8b3-f38a-4078-a194-58aaaba45607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:11.313536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7d8b3-f38a-4078-a194-58aaaba45607 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.313875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7d8b3-f38a-4078-a194-58aaaba45607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.314142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7d8b3-f38a-4078-a194-58aaaba45607 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.314757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7d8b3-f38a-4078-a194-58aaaba45607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.316629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7d8b3-f38a-4078-a194-58aaaba45607 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.342899 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1131/2257] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:11 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:11.347888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9ed6-6b2b-4e44-bc78-d8e15b167718 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:11.358271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc9ed6-6b2b-4e44-bc78-d8e15b167718 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:11.413518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad2615-c5ec-4c85-8715-c51887d99ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:11.414343 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad2615-c5ec-4c85-8715-c51887d99ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.414618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad2615-c5ec-4c85-8715-c51887d99ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.414884 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad2615-c5ec-4c85-8715-c51887d99ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.415497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad2615-c5ec-4c85-8715-c51887d99ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.417415 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad2615-c5ec-4c85-8715-c51887d99ab4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.426390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:11.438505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1127/2258] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:11 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:11.442433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7d8b3-f38a-4078-a194-58aaaba45607 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:11.452413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7d8b3-f38a-4078-a194-58aaaba45607 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:11.457857 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ae536-75a2-4155-84e1-d6f6e8f6bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:11.458441 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ae536-75a2-4155-84e1-d6f6e8f6bcfc admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.458713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ae536-75a2-4155-84e1-d6f6e8f6bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.458981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ae536-75a2-4155-84e1-d6f6e8f6bcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.459609 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ae536-75a2-4155-84e1-d6f6e8f6bcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.461220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ae536-75a2-4155-84e1-d6f6e8f6bcfc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.472171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1132/2259] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:11.476429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad2615-c5ec-4c85-8715-c51887d99ab4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:11.486518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad2615-c5ec-4c85-8715-c51887d99ab4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:11.491085 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a2c4d-7365-4a61-9f74-2f4d7be07911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:11.491721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a2c4d-7365-4a61-9f74-2f4d7be07911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.491996 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a2c4d-7365-4a61-9f74-2f4d7be07911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.492266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a2c4d-7365-4a61-9f74-2f4d7be07911 admin admin] PATH_INFO: `/v3/projects/925a0a4d99614b69975aa610cb2a870b/users/3cff810d4f2f47eebb4006906a4be3b9/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.506754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a2c4d-7365-4a61-9f74-2f4d7be07911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925a0a4d99614b69975aa610cb2a870b, user_id=3cff810d4f2f47eebb4006906a4be3b9, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.509424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a2c4d-7365-4a61-9f74-2f4d7be07911 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.523408 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1128/2260] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:11 2022] PUT /identity/v3/projects/925a0a4d99614b69975aa610cb2a870b/users/3cff810d4f2f47eebb4006906a4be3b9/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:11.527832 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ae536-75a2-4155-84e1-d6f6e8f6bcfc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:11.539229 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ae536-75a2-4155-84e1-d6f6e8f6bcfc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:11.550411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:11.595094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941f2da-cde3-46a9-ba14-eedc3488f0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:11.595713 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f2da-cde3-46a9-ba14-eedc3488f0dd admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.595989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f2da-cde3-46a9-ba14-eedc3488f0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.596254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f2da-cde3-46a9-ba14-eedc3488f0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.596882 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941f2da-cde3-46a9-ba14-eedc3488f0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.598742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941f2da-cde3-46a9-ba14-eedc3488f0dd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.608600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1133/2261] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:11.613395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a2c4d-7365-4a61-9f74-2f4d7be07911 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:11.623915 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a2c4d-7365-4a61-9f74-2f4d7be07911 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:11.629772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda79ab-625c-49f1-ad00-33b1c3b58d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:11.630411 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda79ab-625c-49f1-ad00-33b1c3b58d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.630689 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda79ab-625c-49f1-ad00-33b1c3b58d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.630957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda79ab-625c-49f1-ad00-33b1c3b58d3a admin admin] PATH_INFO: `/v3/projects/925a0a4d99614b69975aa610cb2a870b/users/3cff810d4f2f47eebb4006906a4be3b9/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.632876 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda79ab-625c-49f1-ad00-33b1c3b58d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=925a0a4d99614b69975aa610cb2a870b, user_id=3cff810d4f2f47eebb4006906a4be3b9, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.635537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda79ab-625c-49f1-ad00-33b1c3b58d3a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.646043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1129/2262] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:11 2022] PUT /identity/v3/projects/925a0a4d99614b69975aa610cb2a870b/users/3cff810d4f2f47eebb4006906a4be3b9/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:11.656233 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06442df-1010-4bdb-baef-c7bfdaf83308 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.656515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06442df-1010-4bdb-baef-c7bfdaf83308 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.656788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06442df-1010-4bdb-baef-c7bfdaf83308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.685073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-e06442df-1010-4bdb-baef-c7bfdaf83308 None None] MFA Rules not processed for user `3cff810d4f2f47eebb4006906a4be3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:11.686214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e06442df-1010-4bdb-baef-c7bfdaf83308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:11.754894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1134/2263] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:11.765777 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda79ab-625c-49f1-ad00-33b1c3b58d3a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:11.822323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda79ab-625c-49f1-ad00-33b1c3b58d3a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:11.825994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cd1a6-7db0-44f1-8d31-256a856cfc8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:11.826701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cd1a6-7db0-44f1-8d31-256a856cfc8f service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:11.826979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cd1a6-7db0-44f1-8d31-256a856cfc8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:11.827333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cd1a6-7db0-44f1-8d31-256a856cfc8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:11.837426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cd1a6-7db0-44f1-8d31-256a856cfc8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:11.838849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cd1a6-7db0-44f1-8d31-256a856cfc8f service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:11.849943 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1130/2264] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:12.359509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06442df-1010-4bdb-baef-c7bfdaf83308 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:12.360897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-e06442df-1010-4bdb-baef-c7bfdaf83308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:12.372413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06442df-1010-4bdb-baef-c7bfdaf83308 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:12.375918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06269b-450a-49ba-9964-8d12cdfeb6fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:12.376506 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06269b-450a-49ba-9964-8d12cdfeb6fe service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:12.376775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06269b-450a-49ba-9964-8d12cdfeb6fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:12.377068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06269b-450a-49ba-9964-8d12cdfeb6fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:12.432228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06269b-450a-49ba-9964-8d12cdfeb6fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:12.433687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06269b-450a-49ba-9964-8d12cdfeb6fe service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:12.442920 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1135/2265] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:16.480361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cd1a6-7db0-44f1-8d31-256a856cfc8f service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:16.489679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cd1a6-7db0-44f1-8d31-256a856cfc8f service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:16.493263 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1985b-5a9b-4e84-acc5-166e41a9250b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:16.493843 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1985b-5a9b-4e84-acc5-166e41a9250b service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:16.494111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1985b-5a9b-4e84-acc5-166e41a9250b service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:16.494373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1985b-5a9b-4e84-acc5-166e41a9250b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:16.551232 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1985b-5a9b-4e84-acc5-166e41a9250b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:16.552642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1985b-5a9b-4e84-acc5-166e41a9250b service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:16.561407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1131/2266] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:18.657581 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06269b-450a-49ba-9964-8d12cdfeb6fe service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:18.697603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:18.721796 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06269b-450a-49ba-9964-8d12cdfeb6fe service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:18.726445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:18.727055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:18.727325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:18.727591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] PATH_INFO: `/v3/users/301d30d52e3a43f1a7c4a7c9d6d772db` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:18.728680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=301d30d52e3a43f1a7c4a7c9d6d772db)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:18.730595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:18.775528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '301d30d52e3a43f1a7c4a7c9d6d772db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:18.783198 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '301d30d52e3a43f1a7c4a7c9d6d772db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:18.783835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '301d30d52e3a43f1a7c4a7c9d6d772db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:18.795278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '301d30d52e3a43f1a7c4a7c9d6d772db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:18.802210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '301d30d52e3a43f1a7c4a7c9d6d772db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:18.812244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1136/2267] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:18 2022] DELETE /identity/v3/users/301d30d52e3a43f1a7c4a7c9d6d772db => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:18.816771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f4b7d-29e7-4b63-815b-58556c15da08 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:18.817275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f4b7d-29e7-4b63-815b-58556c15da08 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:18.817389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f4b7d-29e7-4b63-815b-58556c15da08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:18.836334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e14f4b7d-29e7-4b63-815b-58556c15da08 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:18.837562 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e14f4b7d-29e7-4b63-815b-58556c15da08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:18.886010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:18.898664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1132/2268] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:18.908871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:18.910472 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:18.967689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6075cb-d397-4e8e-aea1-6dbbfed91e59 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:18.972127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f7206-672d-432d-8a1b-24e7b22998fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:18.972906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f7206-672d-432d-8a1b-24e7b22998fa service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:18.973210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f7206-672d-432d-8a1b-24e7b22998fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:18.973479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f7206-672d-432d-8a1b-24e7b22998fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:18.982525 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f7206-672d-432d-8a1b-24e7b22998fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:18.983978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f7206-672d-432d-8a1b-24e7b22998fa service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:18.993390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1137/2269] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:19.260234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f4b7d-29e7-4b63-815b-58556c15da08 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:19.262325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e14f4b7d-29e7-4b63-815b-58556c15da08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:19.276315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f4b7d-29e7-4b63-815b-58556c15da08 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:19.281596 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:19.282231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:19.282508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:19.282795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] PATH_INFO: `/v3/projects/f4f862be225f4692b6589e7891ec2445` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:19.283964 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f862be225f4692b6589e7891ec2445)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:19.286059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:19.339122 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f862be225f4692b6589e7891ec2445', 'request_id': 'req-586bcdab-8a79-4c66-a606-14656e769d12'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.349585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f862be225f4692b6589e7891ec2445', 'request_id': 'req-586bcdab-8a79-4c66-a606-14656e769d12'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.355910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f862be225f4692b6589e7891ec2445', 'request_id': 'req-586bcdab-8a79-4c66-a606-14656e769d12'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.371481 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] The token cache is being invalidate because project f4f862be225f4692b6589e7891ec2445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:19.371795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.372427 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.374149 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1133/2270] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:19 2022] DELETE /identity/v3/projects/f4f862be225f4692b6589e7891ec2445 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:19.378283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f7206-672d-432d-8a1b-24e7b22998fa service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:19.388331 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f7206-672d-432d-8a1b-24e7b22998fa service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:19.443712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:19.450270 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:19.451274 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:19.451562 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:19.451834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] PATH_INFO: `/v3/users/4430616964514d3e9b7ab71a09b86664` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:19.453088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4430616964514d3e9b7ab71a09b86664)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:19.455695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:19.500974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4430616964514d3e9b7ab71a09b86664'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.508345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4430616964514d3e9b7ab71a09b86664'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.508962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4430616964514d3e9b7ab71a09b86664'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.521962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4430616964514d3e9b7ab71a09b86664'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.529215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4430616964514d3e9b7ab71a09b86664'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.536035 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1138/2271] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:19 2022] DELETE /identity/v3/users/4430616964514d3e9b7ab71a09b86664 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:19.809750 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:19.811387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:19.826525 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bcdab-8a79-4c66-a606-14656e769d12 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:19.886469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:19.887095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:19.887371 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:19.887642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] PATH_INFO: `/v3/projects/ba5542ed83674d4fb9ef98cd96e9785c` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:19.888763 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5542ed83674d4fb9ef98cd96e9785c)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:19.890701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:19.937580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5542ed83674d4fb9ef98cd96e9785c', 'request_id': 'req-5102fc6c-908c-4085-8a16-73b064d2914d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.943667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5542ed83674d4fb9ef98cd96e9785c', 'request_id': 'req-5102fc6c-908c-4085-8a16-73b064d2914d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.949659 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5542ed83674d4fb9ef98cd96e9785c', 'request_id': 'req-5102fc6c-908c-4085-8a16-73b064d2914d'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.962051 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] The token cache is being invalidate because project ba5542ed83674d4fb9ef98cd96e9785c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:19.962328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.962933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:19.964405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1134/2272] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:19 2022] DELETE /identity/v3/projects/ba5542ed83674d4fb9ef98cd96e9785c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:19.968379 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:19.970045 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:19.983008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed046c-40bc-4208-8897-a0de079f2359 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:20.038546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:20.039086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:20.039357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:20.039622 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] PATH_INFO: `/v3/users/3cff810d4f2f47eebb4006906a4be3b9` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:20.040714 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cff810d4f2f47eebb4006906a4be3b9)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:20.042644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:20.086946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cff810d4f2f47eebb4006906a4be3b9'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:20.094007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cff810d4f2f47eebb4006906a4be3b9'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:20.095101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cff810d4f2f47eebb4006906a4be3b9'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:20.107230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cff810d4f2f47eebb4006906a4be3b9'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:20.112533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:20.114500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-6fc6a620-f60c-4430-b1ff-77e975e50282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cff810d4f2f47eebb4006906a4be3b9'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:20.121569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1139/2273] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:19 2022] DELETE /identity/v3/users/3cff810d4f2f47eebb4006906a4be3b9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:20.399150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:20.400593 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:20.415165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102fc6c-908c-4085-8a16-73b064d2914d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:20.420054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:20.479491 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:20.480130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:20.480412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:20.480688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] PATH_INFO: `/v3/projects/925a0a4d99614b69975aa610cb2a870b` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:20.481854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925a0a4d99614b69975aa610cb2a870b)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:20.483748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:20.531292 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925a0a4d99614b69975aa610cb2a870b', 'request_id': 'req-a1a2072f-3265-46fe-b9e7-e58e2d77c163'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:20.537418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925a0a4d99614b69975aa610cb2a870b', 'request_id': 'req-a1a2072f-3265-46fe-b9e7-e58e2d77c163'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:20.543453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925a0a4d99614b69975aa610cb2a870b', 'request_id': 'req-a1a2072f-3265-46fe-b9e7-e58e2d77c163'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:20.557421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] The token cache is being invalidate because project 925a0a4d99614b69975aa610cb2a870b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:20.557705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:20.558378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-a1a2072f-3265-46fe-b9e7-e58e2d77c163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:20.559881 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1135/2274] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:20 2022] DELETE /identity/v3/projects/925a0a4d99614b69975aa610cb2a870b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:20.565814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f316e1-94c0-4256-89bc-fce181d080ec None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:20.566098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f316e1-94c0-4256-89bc-fce181d080ec None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:20.566372 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f316e1-94c0-4256-89bc-fce181d080ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:20.586709 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-26f316e1-94c0-4256-89bc-fce181d080ec None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:20.587831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-26f316e1-94c0-4256-89bc-fce181d080ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:20.658577 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1140/2275] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:20.666808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574bc5-daaf-4a9b-a79b-d5512d4fe28d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:20.667107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574bc5-daaf-4a9b-a79b-d5512d4fe28d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:20.667361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574bc5-daaf-4a9b-a79b-d5512d4fe28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:20.690484 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a9574bc5-daaf-4a9b-a79b-d5512d4fe28d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:20.691699 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a9574bc5-daaf-4a9b-a79b-d5512d4fe28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:20.699713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1136/2276] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:20.704052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f316e1-94c0-4256-89bc-fce181d080ec None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:20.714282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f316e1-94c0-4256-89bc-fce181d080ec None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:20.719898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d346-6775-42de-9907-29081c48d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:20.720911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d346-6775-42de-9907-29081c48d758 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:20.721306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d346-6775-42de-9907-29081c48d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:20.721644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d346-6775-42de-9907-29081c48d758 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:20.722385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d346-6775-42de-9907-29081c48d758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:20.722982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d346-6775-42de-9907-29081c48d758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:20.724640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d346-6775-42de-9907-29081c48d758 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:20.737375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1141/2277] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:33:20.741759 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574bc5-daaf-4a9b-a79b-d5512d4fe28d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:20.751125 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574bc5-daaf-4a9b-a79b-d5512d4fe28d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:20.757197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0375c-e5da-4c9b-81d7-626f4629dac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:20.758033 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0375c-e5da-4c9b-81d7-626f4629dac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:20.758387 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0375c-e5da-4c9b-81d7-626f4629dac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:20.758662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0375c-e5da-4c9b-81d7-626f4629dac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:20.759307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0375c-e5da-4c9b-81d7-626f4629dac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:20.761243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0375c-e5da-4c9b-81d7-626f4629dac5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:20.791320 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1137/2278] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:20 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:33:20.799603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d346-6775-42de-9907-29081c48d758 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:20.807095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d346-6775-42de-9907-29081c48d758 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:20.868107 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9189ca-368f-45b1-b38a-6fbedeebcc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:20.868709 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9189ca-368f-45b1-b38a-6fbedeebcc0d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:20.868982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9189ca-368f-45b1-b38a-6fbedeebcc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:20.869281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9189ca-368f-45b1-b38a-6fbedeebcc0d admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:20.869916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9189ca-368f-45b1-b38a-6fbedeebcc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:20.871825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9189ca-368f-45b1-b38a-6fbedeebcc0d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:20.897048 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1142/2279] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:20 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:33:20.900475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0375c-e5da-4c9b-81d7-626f4629dac5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:20.915845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0375c-e5da-4c9b-81d7-626f4629dac5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:20.920692 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068352e-dc4e-4907-9f3b-3f2673a941e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:20.921323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068352e-dc4e-4907-9f3b-3f2673a941e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:20.921598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068352e-dc4e-4907-9f3b-3f2673a941e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:20.921865 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068352e-dc4e-4907-9f3b-3f2673a941e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:20.922567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068352e-dc4e-4907-9f3b-3f2673a941e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:20.924844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068352e-dc4e-4907-9f3b-3f2673a941e6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:20.939911 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1138/2280] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:20.943776 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9189ca-368f-45b1-b38a-6fbedeebcc0d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:20.954294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9189ca-368f-45b1-b38a-6fbedeebcc0d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:20.959092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c58870-f8ae-46d5-9031-5d6abc725a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:20.959692 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58870-f8ae-46d5-9031-5d6abc725a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:20.959978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58870-f8ae-46d5-9031-5d6abc725a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:20.960251 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c58870-f8ae-46d5-9031-5d6abc725a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:20.960894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c58870-f8ae-46d5-9031-5d6abc725a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:20.962531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c58870-f8ae-46d5-9031-5d6abc725a67 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:20.975303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1143/2281] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:20.979539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068352e-dc4e-4907-9f3b-3f2673a941e6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:20.989773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068352e-dc4e-4907-9f3b-3f2673a941e6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:20.994425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43b9f3-e6cb-4866-8773-3a626071047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:20.995061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43b9f3-e6cb-4866-8773-3a626071047f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:20.995342 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43b9f3-e6cb-4866-8773-3a626071047f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:20.995617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43b9f3-e6cb-4866-8773-3a626071047f admin admin] PATH_INFO: `/v3/projects/bfdeb37fca594d2cb9f2ac8166937cac/users/fe633d1015334083b378a1ff4526d848/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.010864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43b9f3-e6cb-4866-8773-3a626071047f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdeb37fca594d2cb9f2ac8166937cac, user_id=fe633d1015334083b378a1ff4526d848, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:21.013661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43b9f3-e6cb-4866-8773-3a626071047f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:21.027660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1139/2282] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:20 2022] PUT /identity/v3/projects/bfdeb37fca594d2cb9f2ac8166937cac/users/fe633d1015334083b378a1ff4526d848/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:21.040391 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4303043-a5e9-497c-8134-4c967ef26d69 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.040675 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4303043-a5e9-497c-8134-4c967ef26d69 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.040960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4303043-a5e9-497c-8134-4c967ef26d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.069572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a4303043-a5e9-497c-8134-4c967ef26d69 None None] MFA Rules not processed for user `fe633d1015334083b378a1ff4526d848`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:21.070984 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a4303043-a5e9-497c-8134-4c967ef26d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:21.119974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:21.138928 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1144/2283] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:21.143434 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43b9f3-e6cb-4866-8773-3a626071047f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:21.181255 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:21.206054 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43b9f3-e6cb-4866-8773-3a626071047f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:21.210753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e41c89-14d9-48a5-83fa-36de32c21fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:21.211359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41c89-14d9-48a5-83fa-36de32c21fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.211632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41c89-14d9-48a5-83fa-36de32c21fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.211896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41c89-14d9-48a5-83fa-36de32c21fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.212505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e41c89-14d9-48a5-83fa-36de32c21fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:21.214426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e41c89-14d9-48a5-83fa-36de32c21fa2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:21.240569 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1140/2284] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:21 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:21.244645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4303043-a5e9-497c-8134-4c967ef26d69 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:21.256091 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4303043-a5e9-497c-8134-4c967ef26d69 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:21.311223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526b559-e532-4beb-9512-c8c284611b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:21.311853 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b559-e532-4beb-9512-c8c284611b4a admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.312133 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b559-e532-4beb-9512-c8c284611b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.312397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b559-e532-4beb-9512-c8c284611b4a admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.313050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526b559-e532-4beb-9512-c8c284611b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:21.315073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526b559-e532-4beb-9512-c8c284611b4a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:21.342528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1145/2285] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:21 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:21.347062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e41c89-14d9-48a5-83fa-36de32c21fa2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:21.357531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e41c89-14d9-48a5-83fa-36de32c21fa2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:21.362247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7a37a-55d8-4514-9855-0c57b09c3139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:21.362833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7a37a-55d8-4514-9855-0c57b09c3139 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.363112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7a37a-55d8-4514-9855-0c57b09c3139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.363385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7a37a-55d8-4514-9855-0c57b09c3139 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.364020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7a37a-55d8-4514-9855-0c57b09c3139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:21.365636 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7a37a-55d8-4514-9855-0c57b09c3139 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:21.377106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1141/2286] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:21.380958 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526b559-e532-4beb-9512-c8c284611b4a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:21.390749 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526b559-e532-4beb-9512-c8c284611b4a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:21.395931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b207b-712b-4bea-9c2b-05ba47571ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:21.396559 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b207b-712b-4bea-9c2b-05ba47571ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.396831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b207b-712b-4bea-9c2b-05ba47571ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.397144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b207b-712b-4bea-9c2b-05ba47571ec8 admin admin] PATH_INFO: `/v3/projects/f5c10c0fe5354e4dbf0d7f070cdb184d/users/b911da73361b4470a4b948f7ca1c94bb/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.411606 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b207b-712b-4bea-9c2b-05ba47571ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c10c0fe5354e4dbf0d7f070cdb184d, user_id=b911da73361b4470a4b948f7ca1c94bb, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:21.414246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b207b-712b-4bea-9c2b-05ba47571ec8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:21.426413 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1146/2287] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:21 2022] PUT /identity/v3/projects/f5c10c0fe5354e4dbf0d7f070cdb184d/users/b911da73361b4470a4b948f7ca1c94bb/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:21.430257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7a37a-55d8-4514-9855-0c57b09c3139 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:21.441245 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7a37a-55d8-4514-9855-0c57b09c3139 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:21.496640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfff45c-18b7-4259-a931-34d943581614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:21.497266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfff45c-18b7-4259-a931-34d943581614 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.497544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfff45c-18b7-4259-a931-34d943581614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.497814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfff45c-18b7-4259-a931-34d943581614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.498442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfff45c-18b7-4259-a931-34d943581614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:21.500012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfff45c-18b7-4259-a931-34d943581614 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:21.510078 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1142/2288] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:21.514307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b207b-712b-4bea-9c2b-05ba47571ec8 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:21.525269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b207b-712b-4bea-9c2b-05ba47571ec8 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:21.531276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709f3e9-59dc-4cfe-ab4f-f8953f22f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:21.531969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709f3e9-59dc-4cfe-ab4f-f8953f22f7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.532241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709f3e9-59dc-4cfe-ab4f-f8953f22f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.532541 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709f3e9-59dc-4cfe-ab4f-f8953f22f7aa admin admin] PATH_INFO: `/v3/projects/f5c10c0fe5354e4dbf0d7f070cdb184d/users/b911da73361b4470a4b948f7ca1c94bb/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.534773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709f3e9-59dc-4cfe-ab4f-f8953f22f7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c10c0fe5354e4dbf0d7f070cdb184d, user_id=b911da73361b4470a4b948f7ca1c94bb, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:21.537497 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709f3e9-59dc-4cfe-ab4f-f8953f22f7aa admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:21.548180 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1147/2289] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:21 2022] PUT /identity/v3/projects/f5c10c0fe5354e4dbf0d7f070cdb184d/users/b911da73361b4470a4b948f7ca1c94bb/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:21.558487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86cfb9-4436-42b5-bfc3-1bd29d71cb37 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.558772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86cfb9-4436-42b5-bfc3-1bd29d71cb37 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.559043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86cfb9-4436-42b5-bfc3-1bd29d71cb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.587692 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-1c86cfb9-4436-42b5-bfc3-1bd29d71cb37 None None] MFA Rules not processed for user `b911da73361b4470a4b948f7ca1c94bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:21.588892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1c86cfb9-4436-42b5-bfc3-1bd29d71cb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:21.655871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1143/2290] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:21.666951 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709f3e9-59dc-4cfe-ab4f-f8953f22f7aa admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:21.669088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a709f3e9-59dc-4cfe-ab4f-f8953f22f7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:21.728376 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709f3e9-59dc-4cfe-ab4f-f8953f22f7aa admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:21.732011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed7433-1f71-4dee-84f4-5006ad8f4f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:21.732601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed7433-1f71-4dee-84f4-5006ad8f4f27 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.732877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed7433-1f71-4dee-84f4-5006ad8f4f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.733180 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed7433-1f71-4dee-84f4-5006ad8f4f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.743047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed7433-1f71-4dee-84f4-5006ad8f4f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:21.744463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed7433-1f71-4dee-84f4-5006ad8f4f27 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:21.754875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1148/2291] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:21.801026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86cfb9-4436-42b5-bfc3-1bd29d71cb37 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:21.802420 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1c86cfb9-4436-42b5-bfc3-1bd29d71cb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:21.814720 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86cfb9-4436-42b5-bfc3-1bd29d71cb37 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:21.818556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dadd48-e378-4d90-8cec-5225a2e33219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:21.819169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dadd48-e378-4d90-8cec-5225a2e33219 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.819444 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dadd48-e378-4d90-8cec-5225a2e33219 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.819712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dadd48-e378-4d90-8cec-5225a2e33219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.848430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:21.877966 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dadd48-e378-4d90-8cec-5225a2e33219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:21.879379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dadd48-e378-4d90-8cec-5225a2e33219 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:21.888226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1144/2292] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:23.136349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed7433-1f71-4dee-84f4-5006ad8f4f27 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:23.137766 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d4ed7433-1f71-4dee-84f4-5006ad8f4f27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:23.185365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:23.202520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed7433-1f71-4dee-84f4-5006ad8f4f27 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:23.207179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:23.207800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:23.208073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:23.208338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] PATH_INFO: `/v3/users/44e5d71a328e4d47b5432e772c3a5537` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:23.209476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e5d71a328e4d47b5432e772c3a5537)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:23.211365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:23.259768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e5d71a328e4d47b5432e772c3a5537'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:23.269814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e5d71a328e4d47b5432e772c3a5537'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:23.270613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e5d71a328e4d47b5432e772c3a5537'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:23.284576 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e5d71a328e4d47b5432e772c3a5537'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:23.291425 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e5d71a328e4d47b5432e772c3a5537'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:23.297347 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1149/2293] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:23 2022] DELETE /identity/v3/users/44e5d71a328e4d47b5432e772c3a5537 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:23.302276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3144b3f-ce2f-4910-adef-5b3bc89dbc8e None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:23.302751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3144b3f-ce2f-4910-adef-5b3bc89dbc8e None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:23.302866 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3144b3f-ce2f-4910-adef-5b3bc89dbc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:23.322827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e3144b3f-ce2f-4910-adef-5b3bc89dbc8e None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:23.324021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e3144b3f-ce2f-4910-adef-5b3bc89dbc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:23.385240 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1145/2294] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:23.395197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:23.396584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:23.458531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ef029-eab1-464c-a6fe-e7d40d052cb5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:23.462185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641758c-802c-4a26-8991-5182bba5c31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:23.462817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641758c-802c-4a26-8991-5182bba5c31f service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:23.463100 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641758c-802c-4a26-8991-5182bba5c31f service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:23.463429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641758c-802c-4a26-8991-5182bba5c31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:23.473500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641758c-802c-4a26-8991-5182bba5c31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:23.475088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641758c-802c-4a26-8991-5182bba5c31f service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:23.484962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1150/2295] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:23.780390 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3144b3f-ce2f-4910-adef-5b3bc89dbc8e None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:23.782020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e3144b3f-ce2f-4910-adef-5b3bc89dbc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:23.800647 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3144b3f-ce2f-4910-adef-5b3bc89dbc8e None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:23.808245 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:23.809404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:23.809948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:23.810266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] PATH_INFO: `/v3/projects/3f266b15b7a341108845d845e151bb06` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:23.811690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f266b15b7a341108845d845e151bb06)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:23.813651 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:23.866001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f266b15b7a341108845d845e151bb06', 'request_id': 'req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:23.871902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f266b15b7a341108845d845e151bb06', 'request_id': 'req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:23.879293 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f266b15b7a341108845d845e151bb06', 'request_id': 'req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:23.893130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] The token cache is being invalidate because project 3f266b15b7a341108845d845e151bb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:23.893517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:23.894193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:23.895790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1146/2296] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:23 2022] DELETE /identity/v3/projects/3f266b15b7a341108845d845e151bb06 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:23.899829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641758c-802c-4a26-8991-5182bba5c31f service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:23.910822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641758c-802c-4a26-8991-5182bba5c31f service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:23.974955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:23.975591 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:23.975982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:23.976151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] PATH_INFO: `/v3/users/11e91570372d469f9ba45a6b29a6ecdd` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:23.977340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e91570372d469f9ba45a6b29a6ecdd)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:23.979246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:23.990968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:24.032429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e91570372d469f9ba45a6b29a6ecdd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:24.040960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e91570372d469f9ba45a6b29a6ecdd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:24.041684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e91570372d469f9ba45a6b29a6ecdd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:24.055481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e91570372d469f9ba45a6b29a6ecdd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:24.062367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b5bdc95b-93a6-4a1f-96b0-a717d46214a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e91570372d469f9ba45a6b29a6ecdd'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:24.069153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1151/2297] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:23 2022] DELETE /identity/v3/users/11e91570372d469f9ba45a6b29a6ecdd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:24.340796 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:24.342308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:24.358251 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcbc4d-b9c5-41df-9cea-a78ec1b5c69e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:24.409449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:24.419199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:24.420069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.420558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.420832 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] PATH_INFO: `/v3/projects/532a087a680f4c34a7435167dab505d0` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.422021 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=532a087a680f4c34a7435167dab505d0)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:24.424032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:24.469597 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532a087a680f4c34a7435167dab505d0', 'request_id': 'req-e29ee7da-72d7-4393-85b9-e090b295d39f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:24.475261 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532a087a680f4c34a7435167dab505d0', 'request_id': 'req-e29ee7da-72d7-4393-85b9-e090b295d39f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:24.481317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532a087a680f4c34a7435167dab505d0', 'request_id': 'req-e29ee7da-72d7-4393-85b9-e090b295d39f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:24.493623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] The token cache is being invalidate because project 532a087a680f4c34a7435167dab505d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:24.493908 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:24.494620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e29ee7da-72d7-4393-85b9-e090b295d39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:24.496080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1147/2298] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:24 2022] DELETE /identity/v3/projects/532a087a680f4c34a7435167dab505d0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:24.500849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7599b8-4aac-4e24-accd-0e8aff074724 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.501326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7599b8-4aac-4e24-accd-0e8aff074724 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.501420 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7599b8-4aac-4e24-accd-0e8aff074724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.523108 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0d7599b8-4aac-4e24-accd-0e8aff074724 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:24.524297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0d7599b8-4aac-4e24-accd-0e8aff074724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:24.582060 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1152/2299] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:24.589660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e660242-35e5-423c-bf0f-8de9c872c6d3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.589947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e660242-35e5-423c-bf0f-8de9c872c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.590236 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e660242-35e5-423c-bf0f-8de9c872c6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.610069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5e660242-35e5-423c-bf0f-8de9c872c6d3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:24.611519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5e660242-35e5-423c-bf0f-8de9c872c6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:24.619439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1148/2300] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:24.623495 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7599b8-4aac-4e24-accd-0e8aff074724 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:24.633656 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7599b8-4aac-4e24-accd-0e8aff074724 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:24.638155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3a090-9697-4972-a1bc-f391b33d9d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:24.638734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3a090-9697-4972-a1bc-f391b33d9d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.639004 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3a090-9697-4972-a1bc-f391b33d9d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.639268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3a090-9697-4972-a1bc-f391b33d9d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.639898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3a090-9697-4972-a1bc-f391b33d9d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:24.640192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3a090-9697-4972-a1bc-f391b33d9d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:24.641808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3a090-9697-4972-a1bc-f391b33d9d74 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:24.653123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1153/2301] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:33:24.657330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e660242-35e5-423c-bf0f-8de9c872c6d3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:24.666999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e660242-35e5-423c-bf0f-8de9c872c6d3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:24.671946 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120de175-9bcf-4d84-8fb3-53f9255c3b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:24.672531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120de175-9bcf-4d84-8fb3-53f9255c3b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.672804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120de175-9bcf-4d84-8fb3-53f9255c3b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.673112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120de175-9bcf-4d84-8fb3-53f9255c3b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.674322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120de175-9bcf-4d84-8fb3-53f9255c3b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:24.676234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120de175-9bcf-4d84-8fb3-53f9255c3b36 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:24.702786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1149/2302] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:24 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:24.707035 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3a090-9697-4972-a1bc-f391b33d9d74 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:24.716732 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3a090-9697-4972-a1bc-f391b33d9d74 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:24.771723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df055bd-6dcc-4240-8d25-f96e11c8cb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:24.772235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df055bd-6dcc-4240-8d25-f96e11c8cb91 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.772508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df055bd-6dcc-4240-8d25-f96e11c8cb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.772772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df055bd-6dcc-4240-8d25-f96e11c8cb91 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.773416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df055bd-6dcc-4240-8d25-f96e11c8cb91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:24.775325 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df055bd-6dcc-4240-8d25-f96e11c8cb91 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:24.796869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1154/2303] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:24 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:24.801109 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120de175-9bcf-4d84-8fb3-53f9255c3b36 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:24.811405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120de175-9bcf-4d84-8fb3-53f9255c3b36 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:24.816536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaf8c9-80a0-426c-a65b-b8145a8333c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:24.817161 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaf8c9-80a0-426c-a65b-b8145a8333c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.817438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaf8c9-80a0-426c-a65b-b8145a8333c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.817707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaf8c9-80a0-426c-a65b-b8145a8333c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.818340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaf8c9-80a0-426c-a65b-b8145a8333c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:24.820005 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaf8c9-80a0-426c-a65b-b8145a8333c7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:24.831206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1150/2304] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:24.835219 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df055bd-6dcc-4240-8d25-f96e11c8cb91 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:24.841629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:24.845948 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df055bd-6dcc-4240-8d25-f96e11c8cb91 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:24.852314 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6cba7-b48c-4a58-bc66-aed75f901f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:24.853067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6cba7-b48c-4a58-bc66-aed75f901f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.853570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6cba7-b48c-4a58-bc66-aed75f901f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.853868 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6cba7-b48c-4a58-bc66-aed75f901f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.854593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6cba7-b48c-4a58-bc66-aed75f901f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:24.856324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6cba7-b48c-4a58-bc66-aed75f901f24 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:24.866975 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1155/2305] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:24.871227 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaf8c9-80a0-426c-a65b-b8145a8333c7 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:24.881272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaf8c9-80a0-426c-a65b-b8145a8333c7 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:24.885970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983ffdf-e25a-49a6-bc33-da656524ec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:24.886608 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983ffdf-e25a-49a6-bc33-da656524ec54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.886882 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983ffdf-e25a-49a6-bc33-da656524ec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.887147 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983ffdf-e25a-49a6-bc33-da656524ec54 admin admin] PATH_INFO: `/v3/projects/f096c54365714fbb80821966cbcf35e1/users/966c047b4f2746809208963184fec354/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.903676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983ffdf-e25a-49a6-bc33-da656524ec54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f096c54365714fbb80821966cbcf35e1, user_id=966c047b4f2746809208963184fec354, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:24.906411 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983ffdf-e25a-49a6-bc33-da656524ec54 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:24.922078 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1151/2306] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:24 2022] PUT /identity/v3/projects/f096c54365714fbb80821966cbcf35e1/users/966c047b4f2746809208963184fec354/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:24.934203 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf080f-9841-4259-bca4-090d893c717d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:24.934477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf080f-9841-4259-bca4-090d893c717d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:24.934740 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf080f-9841-4259-bca4-090d893c717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:24.962423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-88cf080f-9841-4259-bca4-090d893c717d None None] MFA Rules not processed for user `966c047b4f2746809208963184fec354`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:24.963604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-88cf080f-9841-4259-bca4-090d893c717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.025664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1156/2307] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:25.030024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983ffdf-e25a-49a6-bc33-da656524ec54 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.093436 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983ffdf-e25a-49a6-bc33-da656524ec54 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.099071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc199-7f2d-4a58-9c3c-de0790649d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.099663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc199-7f2d-4a58-9c3c-de0790649d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.099935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc199-7f2d-4a58-9c3c-de0790649d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.100200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc199-7f2d-4a58-9c3c-de0790649d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.100852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcc199-7f2d-4a58-9c3c-de0790649d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.102748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcc199-7f2d-4a58-9c3c-de0790649d06 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:25.129620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1152/2308] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:25 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:25.133679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf080f-9841-4259-bca4-090d893c717d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.144755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf080f-9841-4259-bca4-090d893c717d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.205679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4ce7-6575-4e4e-815b-4693e9772682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.206279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4ce7-6575-4e4e-815b-4693e9772682 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.206550 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4ce7-6575-4e4e-815b-4693e9772682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.206816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4ce7-6575-4e4e-815b-4693e9772682 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.207442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb4ce7-6575-4e4e-815b-4693e9772682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.209371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb4ce7-6575-4e4e-815b-4693e9772682 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:25.231828 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1157/2309] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:25 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:25.235583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4ce7-6575-4e4e-815b-4693e9772682 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.237381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc199-7f2d-4a58-9c3c-de0790649d06 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.239071 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cbbcc199-7f2d-4a58-9c3c-de0790649d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.245892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4ce7-6575-4e4e-815b-4693e9772682 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.247778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:25.250908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680888e-1399-4b92-882f-83da4fea8854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.252022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680888e-1399-4b92-882f-83da4fea8854 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.252298 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680888e-1399-4b92-882f-83da4fea8854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.252540 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc199-7f2d-4a58-9c3c-de0790649d06 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.252715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680888e-1399-4b92-882f-83da4fea8854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.253375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680888e-1399-4b92-882f-83da4fea8854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.254987 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680888e-1399-4b92-882f-83da4fea8854 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:25.259971 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.260860 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.261363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.261822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] PATH_INFO: `/v3/users/fe633d1015334083b378a1ff4526d848` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.263001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe633d1015334083b378a1ff4526d848)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.264899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:25.265131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1158/2310] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:25.269532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680888e-1399-4b92-882f-83da4fea8854 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.279162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680888e-1399-4b92-882f-83da4fea8854 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.284536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb7adc-35cc-4d7f-a5c0-b4eeeb56a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.285225 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb7adc-35cc-4d7f-a5c0-b4eeeb56a3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.285500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb7adc-35cc-4d7f-a5c0-b4eeeb56a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.285769 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb7adc-35cc-4d7f-a5c0-b4eeeb56a3fd admin admin] PATH_INFO: `/v3/projects/1cfc1b87b32c4a58a651fb7a58628301/users/6363fabea4384c1b91605888ec267b29/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.301508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb7adc-35cc-4d7f-a5c0-b4eeeb56a3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cfc1b87b32c4a58a651fb7a58628301, user_id=6363fabea4384c1b91605888ec267b29, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.304222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb7adc-35cc-4d7f-a5c0-b4eeeb56a3fd admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:25.317536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe633d1015334083b378a1ff4526d848'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:25.318206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe633d1015334083b378a1ff4526d848'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:25.318464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1159/2311] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:25 2022] PUT /identity/v3/projects/1cfc1b87b32c4a58a651fb7a58628301/users/6363fabea4384c1b91605888ec267b29/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:25.322381 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb7adc-35cc-4d7f-a5c0-b4eeeb56a3fd admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.325718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe633d1015334083b378a1ff4526d848'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:25.326357 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe633d1015334083b378a1ff4526d848'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:25.339930 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-7a62e7f0-68e0-4052-904a-ff65aea9b2c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe633d1015334083b378a1ff4526d848'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:25.355016 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1153/2312] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:25 2022] DELETE /identity/v3/users/fe633d1015334083b378a1ff4526d848 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:25.359361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc960117-c9cc-476c-97de-b21a1830a3bd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.359694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc960117-c9cc-476c-97de-b21a1830a3bd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.359973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc960117-c9cc-476c-97de-b21a1830a3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.366028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:25.381579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-bc960117-c9cc-476c-97de-b21a1830a3bd None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:25.382814 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bc960117-c9cc-476c-97de-b21a1830a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.388192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb7adc-35cc-4d7f-a5c0-b4eeeb56a3fd admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.441655 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1154/2313] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:25.444182 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52f53-bce8-4afb-b8ec-3dccf3ed9c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.444801 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52f53-bce8-4afb-b8ec-3dccf3ed9c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.445105 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52f53-bce8-4afb-b8ec-3dccf3ed9c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.445827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff52f53-bce8-4afb-b8ec-3dccf3ed9c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.445998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff52f53-bce8-4afb-b8ec-3dccf3ed9c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.447656 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff52f53-bce8-4afb-b8ec-3dccf3ed9c5c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:25.451664 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc960117-c9cc-476c-97de-b21a1830a3bd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.453482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bc960117-c9cc-476c-97de-b21a1830a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.460933 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1160/2314] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:25.462011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52f53-bce8-4afb-b8ec-3dccf3ed9c5c admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.463651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7ff52f53-bce8-4afb-b8ec-3dccf3ed9c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.476502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff52f53-bce8-4afb-b8ec-3dccf3ed9c5c admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.481138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b18721-6333-4709-91f5-6daa52bc71f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.483960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18721-6333-4709-91f5-6daa52bc71f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.484672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18721-6333-4709-91f5-6daa52bc71f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.484954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18721-6333-4709-91f5-6daa52bc71f7 admin admin] PATH_INFO: `/v3/projects/1cfc1b87b32c4a58a651fb7a58628301/users/6363fabea4384c1b91605888ec267b29/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.487568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b18721-6333-4709-91f5-6daa52bc71f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cfc1b87b32c4a58a651fb7a58628301, user_id=6363fabea4384c1b91605888ec267b29, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.491752 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b18721-6333-4709-91f5-6daa52bc71f7 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:25.502226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1161/2315] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:25 2022] PUT /identity/v3/projects/1cfc1b87b32c4a58a651fb7a58628301/users/6363fabea4384c1b91605888ec267b29/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:25.512186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff7c8-771a-4bd0-bc46-b6b8a71fdcdb None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.512474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff7c8-771a-4bd0-bc46-b6b8a71fdcdb None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.512846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff7c8-771a-4bd0-bc46-b6b8a71fdcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.518278 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc960117-c9cc-476c-97de-b21a1830a3bd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.542404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ebcff7c8-771a-4bd0-bc46-b6b8a71fdcdb None None] MFA Rules not processed for user `6363fabea4384c1b91605888ec267b29`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:25.543530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ebcff7c8-771a-4bd0-bc46-b6b8a71fdcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.549126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:25.569959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35060d2a-3a15-4649-b661-f9db72292185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.570563 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35060d2a-3a15-4649-b661-f9db72292185 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.570840 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35060d2a-3a15-4649-b661-f9db72292185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.571112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35060d2a-3a15-4649-b661-f9db72292185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.616918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1162/2316] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:25.628840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcff7c8-771a-4bd0-bc46-b6b8a71fdcdb None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.630293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ebcff7c8-771a-4bd0-bc46-b6b8a71fdcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.634910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35060d2a-3a15-4649-b661-f9db72292185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.636341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35060d2a-3a15-4649-b661-f9db72292185 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:25.646059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1155/2317] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:33:25.687950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcff7c8-771a-4bd0-bc46-b6b8a71fdcdb None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.691842 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15f3ac-cb7f-4db3-97ee-6bee90d35a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.692440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15f3ac-cb7f-4db3-97ee-6bee90d35a11 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.692709 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15f3ac-cb7f-4db3-97ee-6bee90d35a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.692973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15f3ac-cb7f-4db3-97ee-6bee90d35a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.699819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:25.702311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15f3ac-cb7f-4db3-97ee-6bee90d35a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.704240 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15f3ac-cb7f-4db3-97ee-6bee90d35a11 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:25.715799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1163/2318] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:33:25.761482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35060d2a-3a15-4649-b661-f9db72292185 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.762896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-35060d2a-3a15-4649-b661-f9db72292185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.774951 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35060d2a-3a15-4649-b661-f9db72292185 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.778626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c3951-c404-4a38-97ed-959fc807d922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.779220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c3951-c404-4a38-97ed-959fc807d922 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.779497 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c3951-c404-4a38-97ed-959fc807d922 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.779770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c3951-c404-4a38-97ed-959fc807d922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.781631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b69c3951-c404-4a38-97ed-959fc807d922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.859476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c3951-c404-4a38-97ed-959fc807d922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.861588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c3951-c404-4a38-97ed-959fc807d922 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:25.870942 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1156/2319] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:33:25.931242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15f3ac-cb7f-4db3-97ee-6bee90d35a11 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.932834 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4e15f3ac-cb7f-4db3-97ee-6bee90d35a11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.957753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15f3ac-cb7f-4db3-97ee-6bee90d35a11 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:25.963754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:25.964417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.964698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.964970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] PATH_INFO: `/v3/projects/bfdeb37fca594d2cb9f2ac8166937cac` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.966203 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdeb37fca594d2cb9f2ac8166937cac)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:25.968145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:26.017960 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdeb37fca594d2cb9f2ac8166937cac', 'request_id': 'req-0043cbcf-ddd3-40a6-bdf9-c882530c1189'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.026177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdeb37fca594d2cb9f2ac8166937cac', 'request_id': 'req-0043cbcf-ddd3-40a6-bdf9-c882530c1189'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.032773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdeb37fca594d2cb9f2ac8166937cac', 'request_id': 'req-0043cbcf-ddd3-40a6-bdf9-c882530c1189'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.046343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] The token cache is being invalidate because project bfdeb37fca594d2cb9f2ac8166937cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:26.046632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.047295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.049179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1164/2320] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:25 2022] DELETE /identity/v3/projects/bfdeb37fca594d2cb9f2ac8166937cac => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:26.053485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c3951-c404-4a38-97ed-959fc807d922 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:26.065704 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c3951-c404-4a38-97ed-959fc807d922 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:26.132012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:26.132837 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:26.133253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:26.133407 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] PATH_INFO: `/v3/users/b911da73361b4470a4b948f7ca1c94bb` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:26.134586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b911da73361b4470a4b948f7ca1c94bb)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:26.136550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:26.168637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:26.221491 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b911da73361b4470a4b948f7ca1c94bb'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.222382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b911da73361b4470a4b948f7ca1c94bb'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.234030 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b911da73361b4470a4b948f7ca1c94bb'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.234727 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b911da73361b4470a4b948f7ca1c94bb'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.249462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-e0a51369-ec47-4d3e-9529-bfff03617b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b911da73361b4470a4b948f7ca1c94bb'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.262508 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1157/2321] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:26 2022] DELETE /identity/v3/users/b911da73361b4470a4b948f7ca1c94bb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:26.561654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:26.563128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:26.576814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043cbcf-ddd3-40a6-bdf9-c882530c1189 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:26.637104 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:26.637734 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:26.638011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:26.638279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] PATH_INFO: `/v3/projects/f5c10c0fe5354e4dbf0d7f070cdb184d` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:26.639400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c10c0fe5354e4dbf0d7f070cdb184d)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:26.641323 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:26.687535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c10c0fe5354e4dbf0d7f070cdb184d', 'request_id': 'req-1da6edd1-00c4-4414-835e-2d30766ac40c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.694805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c10c0fe5354e4dbf0d7f070cdb184d', 'request_id': 'req-1da6edd1-00c4-4414-835e-2d30766ac40c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.700315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c10c0fe5354e4dbf0d7f070cdb184d', 'request_id': 'req-1da6edd1-00c4-4414-835e-2d30766ac40c'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.711177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] The token cache is being invalidate because project f5c10c0fe5354e4dbf0d7f070cdb184d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:26.711459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.712088 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1da6edd1-00c4-4414-835e-2d30766ac40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:26.713584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1165/2322] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:26 2022] DELETE /identity/v3/projects/f5c10c0fe5354e4dbf0d7f070cdb184d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:26.718610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3362f40-21bf-4c3c-9b67-3c4c7e749f01 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:26.719081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3362f40-21bf-4c3c-9b67-3c4c7e749f01 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:26.719175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3362f40-21bf-4c3c-9b67-3c4c7e749f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:26.740373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a3362f40-21bf-4c3c-9b67-3c4c7e749f01 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:26.741611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a3362f40-21bf-4c3c-9b67-3c4c7e749f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:26.804595 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1158/2323] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:26.813244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f6e3-b6fa-4433-a317-f585ecf68e10 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:26.813527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f6e3-b6fa-4433-a317-f585ecf68e10 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:26.813804 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f6e3-b6fa-4433-a317-f585ecf68e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:26.834633 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1c14f6e3-b6fa-4433-a317-f585ecf68e10 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:26.835854 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1c14f6e3-b6fa-4433-a317-f585ecf68e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:26.843992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1166/2324] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:26.849248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3362f40-21bf-4c3c-9b67-3c4c7e749f01 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:26.858752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3362f40-21bf-4c3c-9b67-3c4c7e749f01 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:26.864003 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dee77-aa6a-4885-b82d-90b76e29d33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:26.864584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dee77-aa6a-4885-b82d-90b76e29d33a admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:26.864857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dee77-aa6a-4885-b82d-90b76e29d33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:26.865272 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dee77-aa6a-4885-b82d-90b76e29d33a admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:26.865899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dee77-aa6a-4885-b82d-90b76e29d33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:26.866192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dee77-aa6a-4885-b82d-90b76e29d33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:26.867748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dee77-aa6a-4885-b82d-90b76e29d33a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:26.879056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1159/2325] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:33:26.883171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14f6e3-b6fa-4433-a317-f585ecf68e10 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:26.887604 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:26.894070 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14f6e3-b6fa-4433-a317-f585ecf68e10 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:26.899426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7371e1-bc22-4a9d-8184-5538d6971645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:26.900118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7371e1-bc22-4a9d-8184-5538d6971645 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:26.900386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7371e1-bc22-4a9d-8184-5538d6971645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:26.900647 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7371e1-bc22-4a9d-8184-5538d6971645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:26.901301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7371e1-bc22-4a9d-8184-5538d6971645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:26.903190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7371e1-bc22-4a9d-8184-5538d6971645 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:26.931870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1167/2326] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:26 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:26.936086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dee77-aa6a-4885-b82d-90b76e29d33a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:26.946072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dee77-aa6a-4885-b82d-90b76e29d33a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:27.002787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac367b7-dee2-4c00-8fa7-c25439bc1604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:27.003370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac367b7-dee2-4c00-8fa7-c25439bc1604 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:27.003642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac367b7-dee2-4c00-8fa7-c25439bc1604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:27.003909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac367b7-dee2-4c00-8fa7-c25439bc1604 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:27.004520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac367b7-dee2-4c00-8fa7-c25439bc1604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:27.006466 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac367b7-dee2-4c00-8fa7-c25439bc1604 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:27.027146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1160/2327] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:26 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:27.031433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7371e1-bc22-4a9d-8184-5538d6971645 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:27.042287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7371e1-bc22-4a9d-8184-5538d6971645 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:27.046829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646b53a-5e97-46f6-84ca-f697da549b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:27.047416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646b53a-5e97-46f6-84ca-f697da549b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:27.047689 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646b53a-5e97-46f6-84ca-f697da549b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:27.047957 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646b53a-5e97-46f6-84ca-f697da549b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:27.048618 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646b53a-5e97-46f6-84ca-f697da549b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:27.050231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646b53a-5e97-46f6-84ca-f697da549b30 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:27.059925 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1168/2328] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:27.063603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac367b7-dee2-4c00-8fa7-c25439bc1604 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:27.073444 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac367b7-dee2-4c00-8fa7-c25439bc1604 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:27.078001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ab210-7648-4c6e-b0ef-29a2d9800325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:27.078576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ab210-7648-4c6e-b0ef-29a2d9800325 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:27.078847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ab210-7648-4c6e-b0ef-29a2d9800325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:27.079111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ab210-7648-4c6e-b0ef-29a2d9800325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:27.080254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ab210-7648-4c6e-b0ef-29a2d9800325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:27.081855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ab210-7648-4c6e-b0ef-29a2d9800325 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:27.092160 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1161/2329] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:27.096195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646b53a-5e97-46f6-84ca-f697da549b30 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:27.106343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646b53a-5e97-46f6-84ca-f697da549b30 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:27.111432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab7429-8379-4353-a671-f243668fe400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:27.112062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab7429-8379-4353-a671-f243668fe400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:27.112338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab7429-8379-4353-a671-f243668fe400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:27.112607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab7429-8379-4353-a671-f243668fe400 admin admin] PATH_INFO: `/v3/projects/cad8e6386233445c81de8513f803c68f/users/f1eb3fbaa67748768267466e12da58f8/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:27.127718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab7429-8379-4353-a671-f243668fe400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad8e6386233445c81de8513f803c68f, user_id=f1eb3fbaa67748768267466e12da58f8, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:27.130397 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab7429-8379-4353-a671-f243668fe400 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:27.143276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1169/2330] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:27 2022] PUT /identity/v3/projects/cad8e6386233445c81de8513f803c68f/users/f1eb3fbaa67748768267466e12da58f8/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:27.148328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87e0e7-15ab-4886-ad16-26e0c607dd0b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:27.148610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87e0e7-15ab-4886-ad16-26e0c607dd0b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:27.148879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87e0e7-15ab-4886-ad16-26e0c607dd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:27.162001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:27.168222 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-8a87e0e7-15ab-4886-ad16-26e0c607dd0b None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:27.169997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8a87e0e7-15ab-4886-ad16-26e0c607dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:27.230565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1162/2331] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:27.241670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab7429-8379-4353-a671-f243668fe400 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:27.243624 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c8ab7429-8379-4353-a671-f243668fe400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:27.303807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab7429-8379-4353-a671-f243668fe400 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:27.307656 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bba7e-57e0-4ea8-8a34-8284421a8199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:27.308269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bba7e-57e0-4ea8-8a34-8284421a8199 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:27.308672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bba7e-57e0-4ea8-8a34-8284421a8199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:27.308801 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bba7e-57e0-4ea8-8a34-8284421a8199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:27.318934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bba7e-57e0-4ea8-8a34-8284421a8199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:27.320357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bba7e-57e0-4ea8-8a34-8284421a8199 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:27.331782 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1170/2332] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:28.003961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669128-6eb5-4589-9fff-a78732799332 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.004483 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669128-6eb5-4589-9fff-a78732799332 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.004610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669128-6eb5-4589-9fff-a78732799332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.034057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4d669128-6eb5-4589-9fff-a78732799332 None None] MFA Rules not processed for user `f1eb3fbaa67748768267466e12da58f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:28.035973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4d669128-6eb5-4589-9fff-a78732799332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:28.105771 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1163/2333] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:28.110356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bba7e-57e0-4ea8-8a34-8284421a8199 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:28.122405 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bba7e-57e0-4ea8-8a34-8284421a8199 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:28.129183 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334921db-b056-4890-b855-4ec903554688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:28.129810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334921db-b056-4890-b855-4ec903554688 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.130083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334921db-b056-4890-b855-4ec903554688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.130346 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334921db-b056-4890-b855-4ec903554688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.130963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334921db-b056-4890-b855-4ec903554688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:28.132829 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334921db-b056-4890-b855-4ec903554688 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:28.163856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1171/2334] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:28 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:28.167968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d669128-6eb5-4589-9fff-a78732799332 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:28.181756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d669128-6eb5-4589-9fff-a78732799332 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:28.256458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcddb0e-b5a8-4f48-9c1e-dc9c159901c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:28.257100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcddb0e-b5a8-4f48-9c1e-dc9c159901c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.257544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcddb0e-b5a8-4f48-9c1e-dc9c159901c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.257827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcddb0e-b5a8-4f48-9c1e-dc9c159901c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.258511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcddb0e-b5a8-4f48-9c1e-dc9c159901c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:28.260440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcddb0e-b5a8-4f48-9c1e-dc9c159901c4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:28.292317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1164/2335] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:28 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:28.294521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334921db-b056-4890-b855-4ec903554688 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:28.305634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334921db-b056-4890-b855-4ec903554688 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:28.311097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081432a3-3724-4a38-8062-c6654fcde480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:28.311097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081432a3-3724-4a38-8062-c6654fcde480 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.311471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081432a3-3724-4a38-8062-c6654fcde480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.311751 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081432a3-3724-4a38-8062-c6654fcde480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.312422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081432a3-3724-4a38-8062-c6654fcde480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:28.314571 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081432a3-3724-4a38-8062-c6654fcde480 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:28.329762 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1172/2336] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:28.334119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcddb0e-b5a8-4f48-9c1e-dc9c159901c4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:28.348159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcddb0e-b5a8-4f48-9c1e-dc9c159901c4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:28.355580 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e946d-1ba3-45c7-8aae-17e2cb7dbce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:28.356330 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e946d-1ba3-45c7-8aae-17e2cb7dbce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.356705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e946d-1ba3-45c7-8aae-17e2cb7dbce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.357132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e946d-1ba3-45c7-8aae-17e2cb7dbce4 admin admin] PATH_INFO: `/v3/projects/a49d54acd17a481e94cc42395c3c4438/users/6cc4d21c3f9c44dca5f1aff5778d4ba0/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.375419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e946d-1ba3-45c7-8aae-17e2cb7dbce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49d54acd17a481e94cc42395c3c4438, user_id=6cc4d21c3f9c44dca5f1aff5778d4ba0, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:28.379198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e946d-1ba3-45c7-8aae-17e2cb7dbce4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:28.393998 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1165/2337] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:28 2022] PUT /identity/v3/projects/a49d54acd17a481e94cc42395c3c4438/users/6cc4d21c3f9c44dca5f1aff5778d4ba0/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:28.397866 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081432a3-3724-4a38-8062-c6654fcde480 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:28.408361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081432a3-3724-4a38-8062-c6654fcde480 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:28.467509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251019b2-0844-477c-8874-fc3ded0c2764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:28.468104 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251019b2-0844-477c-8874-fc3ded0c2764 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.468380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251019b2-0844-477c-8874-fc3ded0c2764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.468674 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251019b2-0844-477c-8874-fc3ded0c2764 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.469344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251019b2-0844-477c-8874-fc3ded0c2764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:28.471466 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251019b2-0844-477c-8874-fc3ded0c2764 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:28.481505 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1173/2338] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:28.485558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e946d-1ba3-45c7-8aae-17e2cb7dbce4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:28.491836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:28.498370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e946d-1ba3-45c7-8aae-17e2cb7dbce4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:28.503489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4505b-0898-4d8b-b1f8-d0742b3a4c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:28.504135 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4505b-0898-4d8b-b1f8-d0742b3a4c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.504406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4505b-0898-4d8b-b1f8-d0742b3a4c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.504673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4505b-0898-4d8b-b1f8-d0742b3a4c83 admin admin] PATH_INFO: `/v3/projects/a49d54acd17a481e94cc42395c3c4438/users/6cc4d21c3f9c44dca5f1aff5778d4ba0/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.506612 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4505b-0898-4d8b-b1f8-d0742b3a4c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49d54acd17a481e94cc42395c3c4438, user_id=6cc4d21c3f9c44dca5f1aff5778d4ba0, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:28.509232 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4505b-0898-4d8b-b1f8-d0742b3a4c83 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:28.519997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1166/2339] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:28 2022] PUT /identity/v3/projects/a49d54acd17a481e94cc42395c3c4438/users/6cc4d21c3f9c44dca5f1aff5778d4ba0/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:29.355821 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251019b2-0844-477c-8874-fc3ded0c2764 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:29.358151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-251019b2-0844-477c-8874-fc3ded0c2764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:29.370805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251019b2-0844-477c-8874-fc3ded0c2764 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:29.381261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:29.410948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094d94b-d48f-48ab-be7e-19074990a081 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:29.411490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094d94b-d48f-48ab-be7e-19074990a081 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:29.411490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094d94b-d48f-48ab-be7e-19074990a081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:29.440673 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2094d94b-d48f-48ab-be7e-19074990a081 None None] MFA Rules not processed for user `6cc4d21c3f9c44dca5f1aff5778d4ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:29.441996 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2094d94b-d48f-48ab-be7e-19074990a081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:29.447675 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:29.448449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:29.448831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:29.449236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] PATH_INFO: `/v3/users/966c047b4f2746809208963184fec354` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:29.450822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966c047b4f2746809208963184fec354)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:29.453345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:29.510332 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966c047b4f2746809208963184fec354'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:29.519311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966c047b4f2746809208963184fec354'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:29.519929 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966c047b4f2746809208963184fec354'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:29.537044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1167/2340] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:29.559078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966c047b4f2746809208963184fec354'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:29.573412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-1eec752b-c51e-4b40-956e-cb03d841b124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966c047b4f2746809208963184fec354'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:29.584585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1174/2341] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:29 2022] DELETE /identity/v3/users/966c047b4f2746809208963184fec354 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:29.591126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd20905-f52e-436a-b932-a6cd9be961dc None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:29.591681 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd20905-f52e-436a-b932-a6cd9be961dc None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:29.592105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd20905-f52e-436a-b932-a6cd9be961dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:29.605371 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582275-79c3-4bc8-9781-9e42485d45b0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:29.605755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582275-79c3-4bc8-9781-9e42485d45b0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:29.606124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582275-79c3-4bc8-9781-9e42485d45b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:29.617079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-4fd20905-f52e-436a-b932-a6cd9be961dc None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:29.618852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4fd20905-f52e-436a-b932-a6cd9be961dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:29.633459 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-86582275-79c3-4bc8-9781-9e42485d45b0 None None] MFA Rules not processed for user `f1eb3fbaa67748768267466e12da58f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:29.635000 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-86582275-79c3-4bc8-9781-9e42485d45b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:29.700297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1168/2342] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:29.710438 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd20905-f52e-436a-b932-a6cd9be961dc None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:29.713278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1175/2343] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:29.717404 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4fd20905-f52e-436a-b932-a6cd9be961dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:29.724711 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582275-79c3-4bc8-9781-9e42485d45b0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:29.726141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-86582275-79c3-4bc8-9781-9e42485d45b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:29.769804 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:29.787241 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd20905-f52e-436a-b932-a6cd9be961dc None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:29.790931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a40d-641b-4bf3-9d6f-758aa20ffe96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:29.791530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a40d-641b-4bf3-9d6f-758aa20ffe96 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:29.791811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a40d-641b-4bf3-9d6f-758aa20ffe96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:29.792079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a40d-641b-4bf3-9d6f-758aa20ffe96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:29.801197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a40d-641b-4bf3-9d6f-758aa20ffe96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:29.802613 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a40d-641b-4bf3-9d6f-758aa20ffe96 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:29.805449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582275-79c3-4bc8-9781-9e42485d45b0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:29.811073 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8f424-9f6e-4c2a-9c8b-d7dcedcd78e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:29.811672 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8f424-9f6e-4c2a-9c8b-d7dcedcd78e0 service nova] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:29.811946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8f424-9f6e-4c2a-9c8b-d7dcedcd78e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:29.812359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1169/2344] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:33:29.812477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8f424-9f6e-4c2a-9c8b-d7dcedcd78e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:29.814664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5fb8f424-9f6e-4c2a-9c8b-d7dcedcd78e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:29.825181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8f424-9f6e-4c2a-9c8b-d7dcedcd78e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:29.826754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8f424-9f6e-4c2a-9c8b-d7dcedcd78e0 service nova] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:29.836206 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1176/2345] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:33:30.235020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a40d-641b-4bf3-9d6f-758aa20ffe96 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:30.236480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1d25a40d-641b-4bf3-9d6f-758aa20ffe96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:30.249388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a40d-641b-4bf3-9d6f-758aa20ffe96 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:30.254170 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:30.254786 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:30.255066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:30.255343 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] PATH_INFO: `/v3/projects/f096c54365714fbb80821966cbcf35e1` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:30.256446 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f096c54365714fbb80821966cbcf35e1)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:30.258382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:30.275743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:30.321199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f096c54365714fbb80821966cbcf35e1', 'request_id': 'req-955cb468-98d5-4672-b350-4293f66ee8b6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.327199 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f096c54365714fbb80821966cbcf35e1', 'request_id': 'req-955cb468-98d5-4672-b350-4293f66ee8b6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.334701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f096c54365714fbb80821966cbcf35e1', 'request_id': 'req-955cb468-98d5-4672-b350-4293f66ee8b6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.348576 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] The token cache is being invalidate because project f096c54365714fbb80821966cbcf35e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:30.348897 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.349566 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.351027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1170/2346] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:30 2022] DELETE /identity/v3/projects/f096c54365714fbb80821966cbcf35e1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:30.355153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8f424-9f6e-4c2a-9c8b-d7dcedcd78e0 service nova] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:30.366178 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8f424-9f6e-4c2a-9c8b-d7dcedcd78e0 service nova] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:30.424743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:30.425503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:30.425890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:30.426158 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] PATH_INFO: `/v3/users/6363fabea4384c1b91605888ec267b29` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:30.427269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6363fabea4384c1b91605888ec267b29)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:30.429287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:30.496637 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6363fabea4384c1b91605888ec267b29'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.505440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6363fabea4384c1b91605888ec267b29'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.506321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6363fabea4384c1b91605888ec267b29'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.520369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6363fabea4384c1b91605888ec267b29'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.529190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-67c6f2ac-788c-4b3b-8c49-d4e82b023577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6363fabea4384c1b91605888ec267b29'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.535797 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1177/2347] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:30 2022] DELETE /identity/v3/users/6363fabea4384c1b91605888ec267b29 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:30.835018 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:30.837219 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:30.852781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cb468-98d5-4672-b350-4293f66ee8b6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:30.920997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:30.922335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:30.922335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:30.922538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] PATH_INFO: `/v3/projects/1cfc1b87b32c4a58a651fb7a58628301` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:30.924853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cfc1b87b32c4a58a651fb7a58628301)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:30.927143 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:30.980081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cfc1b87b32c4a58a651fb7a58628301', 'request_id': 'req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.987409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cfc1b87b32c4a58a651fb7a58628301', 'request_id': 'req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:30.993875 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cfc1b87b32c4a58a651fb7a58628301', 'request_id': 'req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:31.007115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] The token cache is being invalidate because project 1cfc1b87b32c4a58a651fb7a58628301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:31.007398 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:31.008022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2e9d6e0a-6b50-495b-8b58-bca4adb2f3d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:31.009510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1171/2348] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:30 2022] DELETE /identity/v3/projects/1cfc1b87b32c4a58a651fb7a58628301 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:31.014256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc5d3-9606-4e1a-8b55-e820e236cf80 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.014534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc5d3-9606-4e1a-8b55-e820e236cf80 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.014810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc5d3-9606-4e1a-8b55-e820e236cf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.034279 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ec3fc5d3-9606-4e1a-8b55-e820e236cf80 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:31.035477 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ec3fc5d3-9606-4e1a-8b55-e820e236cf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:31.070608 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:31.101190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1178/2349] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:31.110038 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ff75-49a8-400a-b952-97e12f7dd941 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.110327 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ff75-49a8-400a-b952-97e12f7dd941 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.110605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ff75-49a8-400a-b952-97e12f7dd941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.133248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-ea84ff75-49a8-400a-b952-97e12f7dd941 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:31.134463 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ea84ff75-49a8-400a-b952-97e12f7dd941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:31.142570 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1172/2350] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:31.146916 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fc5d3-9606-4e1a-8b55-e820e236cf80 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.157374 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fc5d3-9606-4e1a-8b55-e820e236cf80 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.162628 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1cf4c-3097-4b95-a5cf-4de2a2f2fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.163231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1cf4c-3097-4b95-a5cf-4de2a2f2fd8b admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.163502 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1cf4c-3097-4b95-a5cf-4de2a2f2fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.163770 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1cf4c-3097-4b95-a5cf-4de2a2f2fd8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.164445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1cf4c-3097-4b95-a5cf-4de2a2f2fd8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:31.164747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1cf4c-3097-4b95-a5cf-4de2a2f2fd8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.166423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1cf4c-3097-4b95-a5cf-4de2a2f2fd8b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.179671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1179/2351] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:33:31.184098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84ff75-49a8-400a-b952-97e12f7dd941 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.193964 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84ff75-49a8-400a-b952-97e12f7dd941 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.198905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82916c6e-e2ce-40da-a31a-d41ab3dec3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.199486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916c6e-e2ce-40da-a31a-d41ab3dec3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.199760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916c6e-e2ce-40da-a31a-d41ab3dec3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.200028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916c6e-e2ce-40da-a31a-d41ab3dec3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.200653 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82916c6e-e2ce-40da-a31a-d41ab3dec3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.202557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82916c6e-e2ce-40da-a31a-d41ab3dec3c9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.231734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1173/2352] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:31 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:31.235970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1cf4c-3097-4b95-a5cf-4de2a2f2fd8b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.245980 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1cf4c-3097-4b95-a5cf-4de2a2f2fd8b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.301169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd612efc-d533-4e5f-8bd5-3dceedffd5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.301764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612efc-d533-4e5f-8bd5-3dceedffd5bc admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.302039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612efc-d533-4e5f-8bd5-3dceedffd5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.302329 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612efc-d533-4e5f-8bd5-3dceedffd5bc admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.302939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd612efc-d533-4e5f-8bd5-3dceedffd5bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.304835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd612efc-d533-4e5f-8bd5-3dceedffd5bc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.326599 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1180/2353] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:31 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:31.331326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82916c6e-e2ce-40da-a31a-d41ab3dec3c9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.336754 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:31.343420 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82916c6e-e2ce-40da-a31a-d41ab3dec3c9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.348878 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e424e-9336-43ea-b9b1-eb968f655368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.349505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e424e-9336-43ea-b9b1-eb968f655368 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.349780 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e424e-9336-43ea-b9b1-eb968f655368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.350047 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e424e-9336-43ea-b9b1-eb968f655368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.350675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e424e-9336-43ea-b9b1-eb968f655368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.352280 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e424e-9336-43ea-b9b1-eb968f655368 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.362135 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1174/2354] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:31.366107 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd612efc-d533-4e5f-8bd5-3dceedffd5bc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.375926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd612efc-d533-4e5f-8bd5-3dceedffd5bc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.381239 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac415c48-229a-4000-8bd8-bf1f98139071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.381831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415c48-229a-4000-8bd8-bf1f98139071 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.382110 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415c48-229a-4000-8bd8-bf1f98139071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.382383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415c48-229a-4000-8bd8-bf1f98139071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.383016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac415c48-229a-4000-8bd8-bf1f98139071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.384607 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac415c48-229a-4000-8bd8-bf1f98139071 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.395199 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1181/2355] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:31.399186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e424e-9336-43ea-b9b1-eb968f655368 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.409773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e424e-9336-43ea-b9b1-eb968f655368 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.414337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1dc6d-5c4f-4477-97ad-38df7e18484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.414960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1dc6d-5c4f-4477-97ad-38df7e18484c admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.415232 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1dc6d-5c4f-4477-97ad-38df7e18484c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.415499 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1dc6d-5c4f-4477-97ad-38df7e18484c admin admin] PATH_INFO: `/v3/projects/e752c70af47d47429a64758a82fcdb61/users/6620ec837b0f4cc59be0616a642d71b2/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.430360 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1dc6d-5c4f-4477-97ad-38df7e18484c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e752c70af47d47429a64758a82fcdb61, user_id=6620ec837b0f4cc59be0616a642d71b2, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.432986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1dc6d-5c4f-4477-97ad-38df7e18484c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.446120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1175/2356] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:31 2022] PUT /identity/v3/projects/e752c70af47d47429a64758a82fcdb61/users/6620ec837b0f4cc59be0616a642d71b2/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:31.457558 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00ca1-0df6-4054-852d-acf55ec46e5e None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.457843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00ca1-0df6-4054-852d-acf55ec46e5e None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.458117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00ca1-0df6-4054-852d-acf55ec46e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.487696 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-a8a00ca1-0df6-4054-852d-acf55ec46e5e None None] MFA Rules not processed for user `6620ec837b0f4cc59be0616a642d71b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:31.488906 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-a8a00ca1-0df6-4054-852d-acf55ec46e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:31.562614 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1182/2357] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:31.566856 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1dc6d-5c4f-4477-97ad-38df7e18484c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.653725 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1dc6d-5c4f-4477-97ad-38df7e18484c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.660020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630432-64bd-493f-bf5f-c71e17ae6392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.660934 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630432-64bd-493f-bf5f-c71e17ae6392 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.661256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630432-64bd-493f-bf5f-c71e17ae6392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.661531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630432-64bd-493f-bf5f-c71e17ae6392 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.662179 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28630432-64bd-493f-bf5f-c71e17ae6392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.664082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28630432-64bd-493f-bf5f-c71e17ae6392 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.697326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1176/2358] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:31 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:31.701520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a00ca1-0df6-4054-852d-acf55ec46e5e None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.713561 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a00ca1-0df6-4054-852d-acf55ec46e5e None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.756914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:31.783781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddeed1-ad00-4a68-a835-f504817192d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.784386 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddeed1-ad00-4a68-a835-f504817192d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.784654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddeed1-ad00-4a68-a835-f504817192d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.784919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddeed1-ad00-4a68-a835-f504817192d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.785572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddeed1-ad00-4a68-a835-f504817192d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.787468 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddeed1-ad00-4a68-a835-f504817192d9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.811957 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1183/2359] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:31 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:31.815200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630432-64bd-493f-bf5f-c71e17ae6392 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.825850 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630432-64bd-493f-bf5f-c71e17ae6392 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.831269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91665507-d8ee-4486-b310-d80811794364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.832098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665507-d8ee-4486-b310-d80811794364 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.832460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665507-d8ee-4486-b310-d80811794364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.832886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665507-d8ee-4486-b310-d80811794364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.833871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91665507-d8ee-4486-b310-d80811794364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.835990 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91665507-d8ee-4486-b310-d80811794364 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.848360 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1177/2360] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:31.852478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddeed1-ad00-4a68-a835-f504817192d9 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.863028 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddeed1-ad00-4a68-a835-f504817192d9 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.867680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90b41-b24f-463d-8eca-d5a1344344bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.868309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90b41-b24f-463d-8eca-d5a1344344bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.868580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90b41-b24f-463d-8eca-d5a1344344bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.868846 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90b41-b24f-463d-8eca-d5a1344344bc admin admin] PATH_INFO: `/v3/projects/a9a3d34e53b14fd19b225f3339b54111/users/ed3bfc8fa8eb468ebbd13ebe058eb68f/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.885464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90b41-b24f-463d-8eca-d5a1344344bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a3d34e53b14fd19b225f3339b54111, user_id=ed3bfc8fa8eb468ebbd13ebe058eb68f, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.888050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90b41-b24f-463d-8eca-d5a1344344bc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.903151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1184/2361] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:31 2022] PUT /identity/v3/projects/a9a3d34e53b14fd19b225f3339b54111/users/ed3bfc8fa8eb468ebbd13ebe058eb68f/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:31.907079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91665507-d8ee-4486-b310-d80811794364 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:31.918539 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91665507-d8ee-4486-b310-d80811794364 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:31.980458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67ae2c-da51-4fbc-937d-89eb3c63b2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:31.981102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ae2c-da51-4fbc-937d-89eb3c63b2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.982746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ae2c-da51-4fbc-937d-89eb3c63b2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.983034 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ae2c-da51-4fbc-937d-89eb3c63b2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.983726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67ae2c-da51-4fbc-937d-89eb3c63b2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:31.986440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67ae2c-da51-4fbc-937d-89eb3c63b2b3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:31.997598 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1178/2362] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:32.001715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90b41-b24f-463d-8eca-d5a1344344bc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:32.013362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90b41-b24f-463d-8eca-d5a1344344bc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:32.018592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7853344-deda-4331-96d8-bf07d0abdbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:32.019246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7853344-deda-4331-96d8-bf07d0abdbee admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:32.019520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7853344-deda-4331-96d8-bf07d0abdbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:32.019789 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7853344-deda-4331-96d8-bf07d0abdbee admin admin] PATH_INFO: `/v3/projects/a9a3d34e53b14fd19b225f3339b54111/users/ed3bfc8fa8eb468ebbd13ebe058eb68f/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:32.022011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7853344-deda-4331-96d8-bf07d0abdbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a3d34e53b14fd19b225f3339b54111, user_id=ed3bfc8fa8eb468ebbd13ebe058eb68f, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:32.024756 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7853344-deda-4331-96d8-bf07d0abdbee admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:32.037046 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1185/2363] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:32 2022] PUT /identity/v3/projects/a9a3d34e53b14fd19b225f3339b54111/users/ed3bfc8fa8eb468ebbd13ebe058eb68f/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:32.047081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fab017-636b-45da-a0ab-f853204c1514 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:32.047362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fab017-636b-45da-a0ab-f853204c1514 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:32.047633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fab017-636b-45da-a0ab-f853204c1514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:32.075302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-62fab017-636b-45da-a0ab-f853204c1514 None None] MFA Rules not processed for user `ed3bfc8fa8eb468ebbd13ebe058eb68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:32.076502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-62fab017-636b-45da-a0ab-f853204c1514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:32.106221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:32.157097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1179/2364] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:32.168086 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7853344-deda-4331-96d8-bf07d0abdbee admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:32.169871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f7853344-deda-4331-96d8-bf07d0abdbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:32.237756 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7853344-deda-4331-96d8-bf07d0abdbee admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:32.241631 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838665-6e13-4eab-9702-34155fc7d764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:32.242366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838665-6e13-4eab-9702-34155fc7d764 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:32.242825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838665-6e13-4eab-9702-34155fc7d764 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:32.243189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838665-6e13-4eab-9702-34155fc7d764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:32.254014 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d838665-6e13-4eab-9702-34155fc7d764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:32.255474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d838665-6e13-4eab-9702-34155fc7d764 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:32.265362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1186/2365] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:32.375373 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fab017-636b-45da-a0ab-f853204c1514 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:32.386475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fab017-636b-45da-a0ab-f853204c1514 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:32.390877 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f6851-3345-4224-865f-e3120f553a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:32.391479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f6851-3345-4224-865f-e3120f553a5e service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:32.391749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f6851-3345-4224-865f-e3120f553a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:32.392050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f6851-3345-4224-865f-e3120f553a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:32.449252 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f6851-3345-4224-865f-e3120f553a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:32.450686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f6851-3345-4224-865f-e3120f553a5e service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:32.460239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1180/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:35.074842 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838665-6e13-4eab-9702-34155fc7d764 service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:35.137437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838665-6e13-4eab-9702-34155fc7d764 service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:35.142010 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:35.142648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:35.142946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:35.143215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] PATH_INFO: `/v3/users/6620ec837b0f4cc59be0616a642d71b2` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:35.144373 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6620ec837b0f4cc59be0616a642d71b2)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:35.146315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:35.188816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:35.203909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6620ec837b0f4cc59be0616a642d71b2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:35.214285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6620ec837b0f4cc59be0616a642d71b2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:35.215264 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6620ec837b0f4cc59be0616a642d71b2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:35.230050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6620ec837b0f4cc59be0616a642d71b2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:35.239016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6620ec837b0f4cc59be0616a642d71b2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:35.245474 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1187/2367] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:35 2022] DELETE /identity/v3/users/6620ec837b0f4cc59be0616a642d71b2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:35.250385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168fc7a-8c52-445d-af77-83d0a0029dda None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:35.250841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168fc7a-8c52-445d-af77-83d0a0029dda None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:35.250926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168fc7a-8c52-445d-af77-83d0a0029dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:35.274879 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e168fc7a-8c52-445d-af77-83d0a0029dda None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:35.276097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e168fc7a-8c52-445d-af77-83d0a0029dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:35.342100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1181/2368] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:35.352744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:35.354197 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:35.414163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6b079-835a-4608-9f28-d1eb7ee00d4d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:35.417941 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ab110-7e34-4d29-851e-cd7b59d2434f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:35.418632 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ab110-7e34-4d29-851e-cd7b59d2434f service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:35.418971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ab110-7e34-4d29-851e-cd7b59d2434f service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:35.419367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ab110-7e34-4d29-851e-cd7b59d2434f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:35.428722 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ab110-7e34-4d29-851e-cd7b59d2434f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:35.430170 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ab110-7e34-4d29-851e-cd7b59d2434f service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:35.439827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1188/2369] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:35.815694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168fc7a-8c52-445d-af77-83d0a0029dda None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:35.817206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e168fc7a-8c52-445d-af77-83d0a0029dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:35.829236 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168fc7a-8c52-445d-af77-83d0a0029dda None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:35.834401 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:35.835037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:35.835320 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:35.835618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] PATH_INFO: `/v3/projects/e752c70af47d47429a64758a82fcdb61` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:35.836730 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e752c70af47d47429a64758a82fcdb61)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:35.839795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:35.897266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e752c70af47d47429a64758a82fcdb61', 'request_id': 'req-f966cac9-29ce-48e0-b79e-f3c192700597'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:35.901793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:35.903192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e752c70af47d47429a64758a82fcdb61', 'request_id': 'req-f966cac9-29ce-48e0-b79e-f3c192700597'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:35.910755 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e752c70af47d47429a64758a82fcdb61', 'request_id': 'req-f966cac9-29ce-48e0-b79e-f3c192700597'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:35.924729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] The token cache is being invalidate because project e752c70af47d47429a64758a82fcdb61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:35.925074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:35.925690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:35.927152 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1182/2370] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:35 2022] DELETE /identity/v3/projects/e752c70af47d47429a64758a82fcdb61 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:35.931352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ab110-7e34-4d29-851e-cd7b59d2434f service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:35.941082 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ab110-7e34-4d29-851e-cd7b59d2434f service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:35.999640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:36.000257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.000532 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.000804 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] PATH_INFO: `/v3/users/ed3bfc8fa8eb468ebbd13ebe058eb68f` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.002411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3bfc8fa8eb468ebbd13ebe058eb68f)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:36.004311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:36.051399 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3bfc8fa8eb468ebbd13ebe058eb68f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:36.058432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3bfc8fa8eb468ebbd13ebe058eb68f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:36.059039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3bfc8fa8eb468ebbd13ebe058eb68f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:36.060119 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:36.074225 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3bfc8fa8eb468ebbd13ebe058eb68f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:36.083528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-46beb5eb-f6bf-4962-91ef-140500be2898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3bfc8fa8eb468ebbd13ebe058eb68f'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:36.089504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1189/2371] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:35 2022] DELETE /identity/v3/users/ed3bfc8fa8eb468ebbd13ebe058eb68f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:36.416660 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:36.418243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:36.432668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966cac9-29ce-48e0-b79e-f3c192700597 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:36.494906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:36.495556 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.495830 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.496097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] PATH_INFO: `/v3/projects/a9a3d34e53b14fd19b225f3339b54111` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.497223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a3d34e53b14fd19b225f3339b54111)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:36.499104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:36.545060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a3d34e53b14fd19b225f3339b54111', 'request_id': 'req-5a40d724-c9b0-4d65-9b16-1c11238b9170'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:36.550533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a3d34e53b14fd19b225f3339b54111', 'request_id': 'req-5a40d724-c9b0-4d65-9b16-1c11238b9170'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:36.556509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a3d34e53b14fd19b225f3339b54111', 'request_id': 'req-5a40d724-c9b0-4d65-9b16-1c11238b9170'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:36.569083 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] The token cache is being invalidate because project a9a3d34e53b14fd19b225f3339b54111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:36.569372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:36.569988 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a40d724-c9b0-4d65-9b16-1c11238b9170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:36.571500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1183/2372] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:36 2022] DELETE /identity/v3/projects/a9a3d34e53b14fd19b225f3339b54111 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:36.576825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9eba-ce9d-48d4-9649-f6e8114862c0 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.577144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9eba-ce9d-48d4-9649-f6e8114862c0 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.577422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9eba-ce9d-48d4-9649-f6e8114862c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.597912 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-294d9eba-ce9d-48d4-9649-f6e8114862c0 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:36.599099 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-294d9eba-ce9d-48d4-9649-f6e8114862c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:36.656566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1190/2373] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:36.664760 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767c739-4abe-4a55-a623-8f964bdb4650 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.665073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767c739-4abe-4a55-a623-8f964bdb4650 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.665348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767c739-4abe-4a55-a623-8f964bdb4650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.686050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-0767c739-4abe-4a55-a623-8f964bdb4650 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:36.687247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-0767c739-4abe-4a55-a623-8f964bdb4650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:36.695392 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1184/2374] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:36.699520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d9eba-ce9d-48d4-9649-f6e8114862c0 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:36.709164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d9eba-ce9d-48d4-9649-f6e8114862c0 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:36.713743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce1978-b00d-418f-8397-48384e223297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:36.714350 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce1978-b00d-418f-8397-48384e223297 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.714603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce1978-b00d-418f-8397-48384e223297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.714870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce1978-b00d-418f-8397-48384e223297 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.715509 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce1978-b00d-418f-8397-48384e223297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:36.715807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce1978-b00d-418f-8397-48384e223297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:36.717423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce1978-b00d-418f-8397-48384e223297 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:36.729583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1191/2375] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:33:36.733680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767c739-4abe-4a55-a623-8f964bdb4650 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:36.743077 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767c739-4abe-4a55-a623-8f964bdb4650 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:36.747680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657cc78-e7d3-4073-89d5-909975fd8fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:36.748256 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657cc78-e7d3-4073-89d5-909975fd8fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.748528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657cc78-e7d3-4073-89d5-909975fd8fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.748821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657cc78-e7d3-4073-89d5-909975fd8fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.749475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657cc78-e7d3-4073-89d5-909975fd8fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:36.751460 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657cc78-e7d3-4073-89d5-909975fd8fd8 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:36.778124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1185/2376] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:36 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:33:36.783008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce1978-b00d-418f-8397-48384e223297 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:36.792877 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce1978-b00d-418f-8397-48384e223297 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:36.849673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d1749-dbdc-4c54-a769-50160edc9158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:36.850278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1749-dbdc-4c54-a769-50160edc9158 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.850587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1749-dbdc-4c54-a769-50160edc9158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.850813 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d1749-dbdc-4c54-a769-50160edc9158 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.851666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d1749-dbdc-4c54-a769-50160edc9158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:36.853612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d1749-dbdc-4c54-a769-50160edc9158 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:36.875983 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1192/2377] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:36 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:36.880901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657cc78-e7d3-4073-89d5-909975fd8fd8 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:36.891473 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657cc78-e7d3-4073-89d5-909975fd8fd8 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:36.896437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798eeac-8953-4da9-93a2-505f31e74f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:36.897065 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798eeac-8953-4da9-93a2-505f31e74f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.897366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798eeac-8953-4da9-93a2-505f31e74f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.897620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798eeac-8953-4da9-93a2-505f31e74f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.898259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798eeac-8953-4da9-93a2-505f31e74f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:36.899845 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798eeac-8953-4da9-93a2-505f31e74f06 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:36.916976 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1186/2378] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:36.920950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d1749-dbdc-4c54-a769-50160edc9158 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:36.931793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d1749-dbdc-4c54-a769-50160edc9158 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:36.936544 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d6895-2afb-4402-bb47-9c348c41ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:36.937187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d6895-2afb-4402-bb47-9c348c41ab78 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.937469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d6895-2afb-4402-bb47-9c348c41ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.937747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d6895-2afb-4402-bb47-9c348c41ab78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.938383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d6895-2afb-4402-bb47-9c348c41ab78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:36.940641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d6895-2afb-4402-bb47-9c348c41ab78 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:36.951879 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1193/2379] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:36.956164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798eeac-8953-4da9-93a2-505f31e74f06 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:36.966069 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798eeac-8953-4da9-93a2-505f31e74f06 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:36.970717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b5c54-6f4f-4bae-b3c6-5b592af11453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:36.971360 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b5c54-6f4f-4bae-b3c6-5b592af11453 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.971635 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b5c54-6f4f-4bae-b3c6-5b592af11453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.971902 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b5c54-6f4f-4bae-b3c6-5b592af11453 admin admin] PATH_INFO: `/v3/projects/a9eb9b6e27c144818048b45e71a32908/users/93a3b30366d74416bee8f24433f26c9f/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.987578 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b5c54-6f4f-4bae-b3c6-5b592af11453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9eb9b6e27c144818048b45e71a32908, user_id=93a3b30366d74416bee8f24433f26c9f, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:36.990269 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b5c54-6f4f-4bae-b3c6-5b592af11453 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:37.004304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1187/2380] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:36 2022] PUT /identity/v3/projects/a9eb9b6e27c144818048b45e71a32908/users/93a3b30366d74416bee8f24433f26c9f/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:37.069396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76493-1a20-4a4b-9624-e1782fbe5966 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:37.069698 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76493-1a20-4a4b-9624-e1782fbe5966 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:37.069970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76493-1a20-4a4b-9624-e1782fbe5966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:37.098070 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-1bf76493-1a20-4a4b-9624-e1782fbe5966 None None] MFA Rules not processed for user `93a3b30366d74416bee8f24433f26c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:37.099250 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-1bf76493-1a20-4a4b-9624-e1782fbe5966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:37.124338 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:37.164888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1194/2381] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:37.169520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b5c54-6f4f-4bae-b3c6-5b592af11453 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:37.183367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:37.238012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b5c54-6f4f-4bae-b3c6-5b592af11453 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:37.242731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a9225-ba06-4962-bc36-c5edd1d0d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:37.243358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a9225-ba06-4962-bc36-c5edd1d0d6fd admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:37.243632 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a9225-ba06-4962-bc36-c5edd1d0d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:37.243899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a9225-ba06-4962-bc36-c5edd1d0d6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:37.244529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a9225-ba06-4962-bc36-c5edd1d0d6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:37.246464 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a9225-ba06-4962-bc36-c5edd1d0d6fd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:37.278066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1188/2382] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:37 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:37.279261 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf76493-1a20-4a4b-9624-e1782fbe5966 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:37.291175 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf76493-1a20-4a4b-9624-e1782fbe5966 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:37.352367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598f8cb-cc74-4e90-9dab-168e75fae398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:37.352978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f8cb-cc74-4e90-9dab-168e75fae398 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:37.353394 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f8cb-cc74-4e90-9dab-168e75fae398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:37.353663 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f8cb-cc74-4e90-9dab-168e75fae398 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:37.354429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598f8cb-cc74-4e90-9dab-168e75fae398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:37.356545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598f8cb-cc74-4e90-9dab-168e75fae398 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:37.380011 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1195/2383] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:37 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:37.383874 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a9225-ba06-4962-bc36-c5edd1d0d6fd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:37.394937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a9225-ba06-4962-bc36-c5edd1d0d6fd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:37.399920 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebb93e-cce7-408d-84b3-04bd3a343d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:37.400587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebb93e-cce7-408d-84b3-04bd3a343d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:37.400869 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebb93e-cce7-408d-84b3-04bd3a343d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:37.401208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebb93e-cce7-408d-84b3-04bd3a343d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:37.401802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebb93e-cce7-408d-84b3-04bd3a343d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:37.403410 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebb93e-cce7-408d-84b3-04bd3a343d3b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:37.418174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1189/2384] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:37.419400 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598f8cb-cc74-4e90-9dab-168e75fae398 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:37.430993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598f8cb-cc74-4e90-9dab-168e75fae398 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:37.436809 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edc846-0f41-446e-8802-030d0e19d640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:37.437557 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc846-0f41-446e-8802-030d0e19d640 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:37.437818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc846-0f41-446e-8802-030d0e19d640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:37.438085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edc846-0f41-446e-8802-030d0e19d640 admin admin] PATH_INFO: `/v3/projects/b1384b32126c4ef39a81f3bc962e8c5b/users/22cfe63c4cd04a5bbc11b0f252c38f47/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:37.454110 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edc846-0f41-446e-8802-030d0e19d640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1384b32126c4ef39a81f3bc962e8c5b, user_id=22cfe63c4cd04a5bbc11b0f252c38f47, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:37.456982 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edc846-0f41-446e-8802-030d0e19d640 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:37.471876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1196/2385] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:37 2022] PUT /identity/v3/projects/b1384b32126c4ef39a81f3bc962e8c5b/users/22cfe63c4cd04a5bbc11b0f252c38f47/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:37.476519 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebb93e-cce7-408d-84b3-04bd3a343d3b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:37.486929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebb93e-cce7-408d-84b3-04bd3a343d3b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:37.559370 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7258f78-93c9-469e-98a6-980cb7a0f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:37.560122 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258f78-93c9-469e-98a6-980cb7a0f865 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:37.560418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258f78-93c9-469e-98a6-980cb7a0f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:37.560638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258f78-93c9-469e-98a6-980cb7a0f865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:37.561316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7258f78-93c9-469e-98a6-980cb7a0f865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:37.562905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7258f78-93c9-469e-98a6-980cb7a0f865 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:37.575243 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1190/2386] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:37.579817 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edc846-0f41-446e-8802-030d0e19d640 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:37.590458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edc846-0f41-446e-8802-030d0e19d640 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:37.596639 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6bef7-f35d-45e3-8477-e30017320191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:37.597348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6bef7-f35d-45e3-8477-e30017320191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:37.597886 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6bef7-f35d-45e3-8477-e30017320191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:37.598218 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6bef7-f35d-45e3-8477-e30017320191 admin admin] PATH_INFO: `/v3/projects/b1384b32126c4ef39a81f3bc962e8c5b/users/22cfe63c4cd04a5bbc11b0f252c38f47/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:37.600186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6bef7-f35d-45e3-8477-e30017320191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1384b32126c4ef39a81f3bc962e8c5b, user_id=22cfe63c4cd04a5bbc11b0f252c38f47, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:37.602993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6bef7-f35d-45e3-8477-e30017320191 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:37.616508 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1197/2387] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:37 2022] PUT /identity/v3/projects/b1384b32126c4ef39a81f3bc962e8c5b/users/22cfe63c4cd04a5bbc11b0f252c38f47/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:37.626712 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386205d-7da0-4f3d-8963-b2acee7e4b87 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:37.627136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386205d-7da0-4f3d-8963-b2acee7e4b87 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:37.627412 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386205d-7da0-4f3d-8963-b2acee7e4b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:37.656806 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7386205d-7da0-4f3d-8963-b2acee7e4b87 None None] MFA Rules not processed for user `22cfe63c4cd04a5bbc11b0f252c38f47`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:37.658634 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7386205d-7da0-4f3d-8963-b2acee7e4b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:37.728175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1191/2388] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:37.739554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6bef7-f35d-45e3-8477-e30017320191 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:37.741309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7eb6bef7-f35d-45e3-8477-e30017320191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:37.797956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6bef7-f35d-45e3-8477-e30017320191 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:37.802160 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62d0cb-a270-43c2-b30d-c15b72dd719f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:37.802755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d0cb-a270-43c2-b30d-c15b72dd719f service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:37.803032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d0cb-a270-43c2-b30d-c15b72dd719f service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:37.803303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d0cb-a270-43c2-b30d-c15b72dd719f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:37.812124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62d0cb-a270-43c2-b30d-c15b72dd719f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:37.813651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62d0cb-a270-43c2-b30d-c15b72dd719f service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:37.823447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1198/2389] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:38.232590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386205d-7da0-4f3d-8963-b2acee7e4b87 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:38.242487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:38.296348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386205d-7da0-4f3d-8963-b2acee7e4b87 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:38.301732 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:38.302349 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:38.302621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:38.302899 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] PATH_INFO: `/v3/users/93a3b30366d74416bee8f24433f26c9f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:38.303979 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a3b30366d74416bee8f24433f26c9f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:38.305912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:38.351181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a3b30366d74416bee8f24433f26c9f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:38.351827 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a3b30366d74416bee8f24433f26c9f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:38.358707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a3b30366d74416bee8f24433f26c9f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:38.359346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a3b30366d74416bee8f24433f26c9f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:38.371558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a3b30366d74416bee8f24433f26c9f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:38.384643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1192/2390] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:38 2022] DELETE /identity/v3/users/93a3b30366d74416bee8f24433f26c9f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:38.400223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38863d-d801-414d-9c35-0a3f78307508 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:38.400856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38863d-d801-414d-9c35-0a3f78307508 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:38.401054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38863d-d801-414d-9c35-0a3f78307508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:38.420350 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-6c38863d-d801-414d-9c35-0a3f78307508 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:38.421580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6c38863d-d801-414d-9c35-0a3f78307508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:38.438601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:38.483294 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1199/2391] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:38.493680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:38.495057 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:38.552798 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83805830-e57c-441f-9bbf-4add32396299 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:38.556487 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d6596-621e-4fb3-a48c-be8a11ce3a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:38.557124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d6596-621e-4fb3-a48c-be8a11ce3a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:38.557405 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d6596-621e-4fb3-a48c-be8a11ce3a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:38.557679 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d6596-621e-4fb3-a48c-be8a11ce3a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:38.567645 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d6596-621e-4fb3-a48c-be8a11ce3a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:38.569099 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d6596-621e-4fb3-a48c-be8a11ce3a7a service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:38.581883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1193/2392] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:38.864112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38863d-d801-414d-9c35-0a3f78307508 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:38.865614 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6c38863d-d801-414d-9c35-0a3f78307508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:38.888705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38863d-d801-414d-9c35-0a3f78307508 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:38.894151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:38.894812 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:38.895149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:38.895486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] PATH_INFO: `/v3/projects/a9eb9b6e27c144818048b45e71a32908` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:38.896685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9eb9b6e27c144818048b45e71a32908)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:38.899040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:38.949994 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9eb9b6e27c144818048b45e71a32908', 'request_id': 'req-975e68a1-a258-4237-bd3d-cafe78b2b5d2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:38.963216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9eb9b6e27c144818048b45e71a32908', 'request_id': 'req-975e68a1-a258-4237-bd3d-cafe78b2b5d2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:38.973541 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9eb9b6e27c144818048b45e71a32908', 'request_id': 'req-975e68a1-a258-4237-bd3d-cafe78b2b5d2'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:38.989990 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] The token cache is being invalidate because project a9eb9b6e27c144818048b45e71a32908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:38.990282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:38.990954 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:38.995738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1200/2393] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:38 2022] DELETE /identity/v3/projects/a9eb9b6e27c144818048b45e71a32908 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:38.996911 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d6596-621e-4fb3-a48c-be8a11ce3a7a service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:39.007237 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d6596-621e-4fb3-a48c-be8a11ce3a7a service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:39.036113 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:39.069726 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:39.070565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.070917 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.071329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] PATH_INFO: `/v3/users/22cfe63c4cd04a5bbc11b0f252c38f47` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.072526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] RBAC: Authorizing `identity:delete_user(user_id=22cfe63c4cd04a5bbc11b0f252c38f47)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:39.074719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:39.133742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22cfe63c4cd04a5bbc11b0f252c38f47'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:39.134764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22cfe63c4cd04a5bbc11b0f252c38f47'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:39.144223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22cfe63c4cd04a5bbc11b0f252c38f47'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:39.145259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22cfe63c4cd04a5bbc11b0f252c38f47'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:39.161835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-c1333824-00a0-43a8-9e22-88380a4f69af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22cfe63c4cd04a5bbc11b0f252c38f47'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:39.177112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1194/2394] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:38 2022] DELETE /identity/v3/users/22cfe63c4cd04a5bbc11b0f252c38f47 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:33:39.464858 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:39.466311 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.480187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e68a1-a258-4237-bd3d-cafe78b2b5d2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:39.537610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:39.538142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.538414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.538680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] PATH_INFO: `/v3/projects/b1384b32126c4ef39a81f3bc962e8c5b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.539772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1384b32126c4ef39a81f3bc962e8c5b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:39.541693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:39.585433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:39.586775 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1384b32126c4ef39a81f3bc962e8c5b', 'request_id': 'req-72f39f7c-8daa-4269-ac74-32c543552355'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:39.595528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1384b32126c4ef39a81f3bc962e8c5b', 'request_id': 'req-72f39f7c-8daa-4269-ac74-32c543552355'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:39.601643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1384b32126c4ef39a81f3bc962e8c5b', 'request_id': 'req-72f39f7c-8daa-4269-ac74-32c543552355'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:39.613380 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] The token cache is being invalidate because project b1384b32126c4ef39a81f3bc962e8c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:39.613666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:39.614301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-72f39f7c-8daa-4269-ac74-32c543552355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:39.615753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1201/2395] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:39 2022] DELETE /identity/v3/projects/b1384b32126c4ef39a81f3bc962e8c5b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:39.620686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32412622-18bd-4901-9e5e-6d676781b9dd None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.621220 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32412622-18bd-4901-9e5e-6d676781b9dd None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.621323 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32412622-18bd-4901-9e5e-6d676781b9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.641029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-32412622-18bd-4901-9e5e-6d676781b9dd None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:39.642378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-32412622-18bd-4901-9e5e-6d676781b9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.701514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1195/2396] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:39.710458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b2696-aee6-4401-bfb3-cc64e7fd6ab8 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.710737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b2696-aee6-4401-bfb3-cc64e7fd6ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.711003 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b2696-aee6-4401-bfb3-cc64e7fd6ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.731231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-c85b2696-aee6-4401-bfb3-cc64e7fd6ab8 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:39.732404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-c85b2696-aee6-4401-bfb3-cc64e7fd6ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.741210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1202/2397] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:39.745406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32412622-18bd-4901-9e5e-6d676781b9dd None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:39.755265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32412622-18bd-4901-9e5e-6d676781b9dd None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:39.759896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c66ee-3f78-407a-91c4-afc1d0ce7b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:39.760558 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c66ee-3f78-407a-91c4-afc1d0ce7b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.760861 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c66ee-3f78-407a-91c4-afc1d0ce7b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.761164 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c66ee-3f78-407a-91c4-afc1d0ce7b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.761803 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c66ee-3f78-407a-91c4-afc1d0ce7b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:39.762106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c66ee-3f78-407a-91c4-afc1d0ce7b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:39.763688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c66ee-3f78-407a-91c4-afc1d0ce7b53 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:39.775690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1196/2398] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:33:39.779754 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b2696-aee6-4401-bfb3-cc64e7fd6ab8 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:39.789462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b2696-aee6-4401-bfb3-cc64e7fd6ab8 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:39.794053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8851b-01c5-4f29-b519-680caab14e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:39.794633 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8851b-01c5-4f29-b519-680caab14e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.794908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8851b-01c5-4f29-b519-680caab14e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.795178 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8851b-01c5-4f29-b519-680caab14e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.795808 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8851b-01c5-4f29-b519-680caab14e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:39.797764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8851b-01c5-4f29-b519-680caab14e60 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:39.824968 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1203/2399] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:39 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:39.829132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c66ee-3f78-407a-91c4-afc1d0ce7b53 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:39.840133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c66ee-3f78-407a-91c4-afc1d0ce7b53 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:39.872058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:39.899154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c43f3c-fde1-4f6b-ae19-e91c87a17388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:39.899753 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c43f3c-fde1-4f6b-ae19-e91c87a17388 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.900025 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c43f3c-fde1-4f6b-ae19-e91c87a17388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.900296 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c43f3c-fde1-4f6b-ae19-e91c87a17388 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.900918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c43f3c-fde1-4f6b-ae19-e91c87a17388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:39.902835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c43f3c-fde1-4f6b-ae19-e91c87a17388 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:39.924433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1197/2400] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:39 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:39.928670 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8851b-01c5-4f29-b519-680caab14e60 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:39.939460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8851b-01c5-4f29-b519-680caab14e60 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:39.944014 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146513cf-c97a-422f-9486-119272593cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:39.944605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146513cf-c97a-422f-9486-119272593cde admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.944874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146513cf-c97a-422f-9486-119272593cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.945169 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146513cf-c97a-422f-9486-119272593cde admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.945796 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146513cf-c97a-422f-9486-119272593cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:39.947357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146513cf-c97a-422f-9486-119272593cde admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:39.957666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1204/2401] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:39.961657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c43f3c-fde1-4f6b-ae19-e91c87a17388 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:39.971694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c43f3c-fde1-4f6b-ae19-e91c87a17388 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:39.976542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045568d-bdc8-42c6-a0a7-253bb91efbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:39.977146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045568d-bdc8-42c6-a0a7-253bb91efbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.977424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045568d-bdc8-42c6-a0a7-253bb91efbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.977693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045568d-bdc8-42c6-a0a7-253bb91efbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.978325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045568d-bdc8-42c6-a0a7-253bb91efbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:39.979904 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045568d-bdc8-42c6-a0a7-253bb91efbb7 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:39.990385 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1198/2402] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:33:39.994465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146513cf-c97a-422f-9486-119272593cde admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:40.004408 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146513cf-c97a-422f-9486-119272593cde admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:40.008869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b5ca4-fadb-40fd-ba27-24f7280bd19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:40.009528 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b5ca4-fadb-40fd-ba27-24f7280bd19a admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:40.009800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b5ca4-fadb-40fd-ba27-24f7280bd19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:40.010067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b5ca4-fadb-40fd-ba27-24f7280bd19a admin admin] PATH_INFO: `/v3/projects/7f423021200d4f2595fc1e04077cfc98/users/aba6865b608b4e5ebd655629debb09db/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:40.025328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b5ca4-fadb-40fd-ba27-24f7280bd19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f423021200d4f2595fc1e04077cfc98, user_id=aba6865b608b4e5ebd655629debb09db, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:40.027935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b5ca4-fadb-40fd-ba27-24f7280bd19a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:40.041467 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1205/2403] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:39 2022] PUT /identity/v3/projects/7f423021200d4f2595fc1e04077cfc98/users/aba6865b608b4e5ebd655629debb09db/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:40.051758 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac06247-e787-416a-aec9-aa59fd1ab083 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:40.052043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac06247-e787-416a-aec9-aa59fd1ab083 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:40.052322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac06247-e787-416a-aec9-aa59fd1ab083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:40.081536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cac06247-e787-416a-aec9-aa59fd1ab083 None None] MFA Rules not processed for user `aba6865b608b4e5ebd655629debb09db`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:40.082729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cac06247-e787-416a-aec9-aa59fd1ab083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:40.146183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1199/2404] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:40.157210 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b5ca4-fadb-40fd-ba27-24f7280bd19a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:40.159366 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9e0b5ca4-fadb-40fd-ba27-24f7280bd19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:40.216238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b5ca4-fadb-40fd-ba27-24f7280bd19a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:40.220822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24dc4f-1cc7-4391-8c52-b59ac9d10166 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27a93c04181493593a069650a977773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:40.221598 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24dc4f-1cc7-4391-8c52-b59ac9d10166 service glance] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:40.221887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24dc4f-1cc7-4391-8c52-b59ac9d10166 service glance] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:40.222163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24dc4f-1cc7-4391-8c52-b59ac9d10166 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:40.231148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24dc4f-1cc7-4391-8c52-b59ac9d10166 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:40.232716 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24dc4f-1cc7-4391-8c52-b59ac9d10166 service glance] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:40.242376 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1206/2405] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:40.529723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac06247-e787-416a-aec9-aa59fd1ab083 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:40.531086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cac06247-e787-416a-aec9-aa59fd1ab083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:40.604305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac06247-e787-416a-aec9-aa59fd1ab083 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:40.607901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e36ad-b429-4a26-9056-224854757b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:40.608506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e36ad-b429-4a26-9056-224854757b36 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:40.608782 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e36ad-b429-4a26-9056-224854757b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:40.609085 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e36ad-b429-4a26-9056-224854757b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:40.611342 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3b6e36ad-b429-4a26-9056-224854757b36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:40.679828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:40.685458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e36ad-b429-4a26-9056-224854757b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:40.687626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e36ad-b429-4a26-9056-224854757b36 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:40.701202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1200/2406] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:46.331215 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced763-5e17-41d1-ab87-aa6ee069480a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:46.332041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced763-5e17-41d1-ab87-aa6ee069480a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:46.332475 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ced763-5e17-41d1-ab87-aa6ee069480a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:46.358831 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-77ced763-5e17-41d1-ab87-aa6ee069480a None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:46.360053 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-77ced763-5e17-41d1-ab87-aa6ee069480a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:46.422307 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1207/2407] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:33:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:46.484789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e36ad-b429-4a26-9056-224854757b36 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:46.487549 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3b6e36ad-b429-4a26-9056-224854757b36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:46.563633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e36ad-b429-4a26-9056-224854757b36 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:46.568797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99136e55-ef72-4d27-a086-89bd5d58ba6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:46.569513 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99136e55-ef72-4d27-a086-89bd5d58ba6a service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:46.569857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99136e55-ef72-4d27-a086-89bd5d58ba6a service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:46.570197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99136e55-ef72-4d27-a086-89bd5d58ba6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:46.578905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99136e55-ef72-4d27-a086-89bd5d58ba6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:46.581026 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99136e55-ef72-4d27-a086-89bd5d58ba6a service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:46.590307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1201/2408] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:33:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:33:56.099540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ced763-5e17-41d1-ab87-aa6ee069480a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:56.129741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:56.211309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ced763-5e17-41d1-ab87-aa6ee069480a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:56.218411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:56.219276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:56.219637 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:56.220035 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] PATH_INFO: `/v3/users/aba6865b608b4e5ebd655629debb09db` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:56.222480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba6865b608b4e5ebd655629debb09db)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:56.225432 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:56.283864 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba6865b608b4e5ebd655629debb09db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:56.291549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba6865b608b4e5ebd655629debb09db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:56.292241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba6865b608b4e5ebd655629debb09db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:56.304658 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba6865b608b4e5ebd655629debb09db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:56.311657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba6865b608b4e5ebd655629debb09db'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:56.318117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1208/2409] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:33:56 2022] DELETE /identity/v3/users/aba6865b608b4e5ebd655629debb09db => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:56.322619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398b9a-328c-436f-b97f-00d024d0c68b None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:56.323074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398b9a-328c-436f-b97f-00d024d0c68b None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:56.323171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398b9a-328c-436f-b97f-00d024d0c68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:56.342362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5c398b9a-328c-436f-b97f-00d024d0c68b None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:56.343559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5c398b9a-328c-436f-b97f-00d024d0c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:56.402557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1202/2410] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:56.413043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:56.414512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:56.472537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7b7f-22ce-47ce-90fb-c3e60703bb79 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:56.476461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40239b38-06ef-4b60-84d8-5e29dfa655bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:56.477126 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239b38-06ef-4b60-84d8-5e29dfa655bf service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:56.477440 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239b38-06ef-4b60-84d8-5e29dfa655bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:56.477640 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239b38-06ef-4b60-84d8-5e29dfa655bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:56.486644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40239b38-06ef-4b60-84d8-5e29dfa655bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:56.488068 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40239b38-06ef-4b60-84d8-5e29dfa655bf service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:56.497646 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1209/2411] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:56.764196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c398b9a-328c-436f-b97f-00d024d0c68b None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:56.765719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5c398b9a-328c-436f-b97f-00d024d0c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:56.784104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c398b9a-328c-436f-b97f-00d024d0c68b None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:56.788900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:56.789568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:56.789869 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:56.790105 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] PATH_INFO: `/v3/projects/7f423021200d4f2595fc1e04077cfc98` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:56.791230 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f423021200d4f2595fc1e04077cfc98)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:56.793223 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:56.842674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f423021200d4f2595fc1e04077cfc98', 'request_id': 'req-b677196c-736c-4340-981d-6b75079ae9fa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:56.850530 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f423021200d4f2595fc1e04077cfc98', 'request_id': 'req-b677196c-736c-4340-981d-6b75079ae9fa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:56.856938 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f423021200d4f2595fc1e04077cfc98', 'request_id': 'req-b677196c-736c-4340-981d-6b75079ae9fa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:56.872894 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] The token cache is being invalidate because project 7f423021200d4f2595fc1e04077cfc98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:33:56.873274 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:56.873991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-b677196c-736c-4340-981d-6b75079ae9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:33:56.875694 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1203/2412] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:33:56 2022] DELETE /identity/v3/projects/7f423021200d4f2595fc1e04077cfc98 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:56.880993 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c7ff-7ed3-4be4-97b5-0372e3ca064a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:56.881309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c7ff-7ed3-4be4-97b5-0372e3ca064a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:56.881584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2c7ff-7ed3-4be4-97b5-0372e3ca064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:56.901963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-dfa2c7ff-7ed3-4be4-97b5-0372e3ca064a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:56.903181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-dfa2c7ff-7ed3-4be4-97b5-0372e3ca064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:56.946150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:56.972102 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1210/2413] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:56.980619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488d3e-4861-46ef-9d76-b16133b3b8e2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:56.981112 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488d3e-4861-46ef-9d76-b16133b3b8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:56.981414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488d3e-4861-46ef-9d76-b16133b3b8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:56.996619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:57.002968 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6a488d3e-4861-46ef-9d76-b16133b3b8e2 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:57.004824 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6a488d3e-4861-46ef-9d76-b16133b3b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:57.013109 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1204/2414] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:57.017876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2c7ff-7ed3-4be4-97b5-0372e3ca064a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:57.027781 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2c7ff-7ed3-4be4-97b5-0372e3ca064a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:57.032330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c70ad-348f-4ebf-a96d-88534f38e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:57.033620 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c70ad-348f-4ebf-a96d-88534f38e38d admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:57.033898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c70ad-348f-4ebf-a96d-88534f38e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:57.034159 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c70ad-348f-4ebf-a96d-88534f38e38d admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:57.034793 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c70ad-348f-4ebf-a96d-88534f38e38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:33:57.035090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c70ad-348f-4ebf-a96d-88534f38e38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:57.036664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c70ad-348f-4ebf-a96d-88534f38e38d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:57.048249 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1211/2415] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:33:57.052675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a488d3e-4861-46ef-9d76-b16133b3b8e2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:57.062159 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a488d3e-4861-46ef-9d76-b16133b3b8e2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:57.066983 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efbeb-df47-403d-8a6a-aa3a10955c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:57.067574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efbeb-df47-403d-8a6a-aa3a10955c0c admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:57.067844 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efbeb-df47-403d-8a6a-aa3a10955c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:57.068107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efbeb-df47-403d-8a6a-aa3a10955c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:57.068736 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87efbeb-df47-403d-8a6a-aa3a10955c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:57.070763 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87efbeb-df47-403d-8a6a-aa3a10955c0c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:57.099449 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1205/2416] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:33:57 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:57.103461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c70ad-348f-4ebf-a96d-88534f38e38d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:57.114057 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c70ad-348f-4ebf-a96d-88534f38e38d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:57.170531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830ba58-71b9-4421-b683-b2482b8d4531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:57.171140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830ba58-71b9-4421-b683-b2482b8d4531 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:57.171415 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830ba58-71b9-4421-b683-b2482b8d4531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:57.171685 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830ba58-71b9-4421-b683-b2482b8d4531 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:57.172322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830ba58-71b9-4421-b683-b2482b8d4531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:57.174898 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830ba58-71b9-4421-b683-b2482b8d4531 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:57.198445 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1212/2417] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:33:57 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:33:57.202225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efbeb-df47-403d-8a6a-aa3a10955c0c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:57.214283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efbeb-df47-403d-8a6a-aa3a10955c0c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:57.220315 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf54f55-47b7-4b9e-9296-dbf672eb44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:57.221040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf54f55-47b7-4b9e-9296-dbf672eb44c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:57.221366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf54f55-47b7-4b9e-9296-dbf672eb44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:57.221643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf54f55-47b7-4b9e-9296-dbf672eb44c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:57.222284 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf54f55-47b7-4b9e-9296-dbf672eb44c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:57.224119 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf54f55-47b7-4b9e-9296-dbf672eb44c2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:57.237500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1206/2418] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:57.241134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830ba58-71b9-4421-b683-b2482b8d4531 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:57.252411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830ba58-71b9-4421-b683-b2482b8d4531 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:57.257579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403607-d060-4b22-973a-9694c8032ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:57.258263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403607-d060-4b22-973a-9694c8032ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:57.258613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403607-d060-4b22-973a-9694c8032ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:57.259083 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403607-d060-4b22-973a-9694c8032ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:57.261067 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403607-d060-4b22-973a-9694c8032ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:57.261296 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403607-d060-4b22-973a-9694c8032ec2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:57.276340 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1213/2419] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:33:57.277775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf54f55-47b7-4b9e-9296-dbf672eb44c2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:57.288642 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf54f55-47b7-4b9e-9296-dbf672eb44c2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:57.294638 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf284fa-da0e-4fc0-aaa5-e5aadcc81dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:57.295368 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf284fa-da0e-4fc0-aaa5-e5aadcc81dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:57.295795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf284fa-da0e-4fc0-aaa5-e5aadcc81dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:57.296131 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf284fa-da0e-4fc0-aaa5-e5aadcc81dc9 admin admin] PATH_INFO: `/v3/projects/6cd7ae2b10db43cbb308eaac2160471c/users/c7bbbbec614b441d8bb6b5f2a0c55218/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:57.315842 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf284fa-da0e-4fc0-aaa5-e5aadcc81dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd7ae2b10db43cbb308eaac2160471c, user_id=c7bbbbec614b441d8bb6b5f2a0c55218, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:57.318918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf284fa-da0e-4fc0-aaa5-e5aadcc81dc9 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:57.334885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1207/2420] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:33:57 2022] PUT /identity/v3/projects/6cd7ae2b10db43cbb308eaac2160471c/users/c7bbbbec614b441d8bb6b5f2a0c55218/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:33:57.358258 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb49c74-444e-477a-8f0b-4af696f07cce None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:57.358549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb49c74-444e-477a-8f0b-4af696f07cce None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:57.361637 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb49c74-444e-477a-8f0b-4af696f07cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:57.405149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-cfb49c74-444e-477a-8f0b-4af696f07cce None None] MFA Rules not processed for user `c7bbbbec614b441d8bb6b5f2a0c55218`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:57.406354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cfb49c74-444e-477a-8f0b-4af696f07cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:57.478952 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1214/2421] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:33:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:57.492733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf284fa-da0e-4fc0-aaa5-e5aadcc81dc9 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:57.494747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-8cf284fa-da0e-4fc0-aaa5-e5aadcc81dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:57.575450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf284fa-da0e-4fc0-aaa5-e5aadcc81dc9 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:57.579167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea96294-84cb-44c5-80fd-1c4529e824ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:57.579709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea96294-84cb-44c5-80fd-1c4529e824ee service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:57.580063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea96294-84cb-44c5-80fd-1c4529e824ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:57.580359 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea96294-84cb-44c5-80fd-1c4529e824ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:57.588821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea96294-84cb-44c5-80fd-1c4529e824ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:57.590270 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea96294-84cb-44c5-80fd-1c4529e824ee service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:57.600082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1208/2422] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:00.430189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb49c74-444e-477a-8f0b-4af696f07cce None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:00.431763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-cfb49c74-444e-477a-8f0b-4af696f07cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:00.475117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:00.493079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb49c74-444e-477a-8f0b-4af696f07cce None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:00.497022 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f281c64-6783-42b0-9eb6-473bcfe267d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:00.497641 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281c64-6783-42b0-9eb6-473bcfe267d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:00.497922 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281c64-6783-42b0-9eb6-473bcfe267d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:00.498195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281c64-6783-42b0-9eb6-473bcfe267d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:00.499921 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0f281c64-6783-42b0-9eb6-473bcfe267d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:00.511587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f281c64-6783-42b0-9eb6-473bcfe267d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:00.513313 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f281c64-6783-42b0-9eb6-473bcfe267d0 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:00.522344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1215/2423] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:34:00.660319 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eca81b-8be0-4916-8828-3f357e0f0ed2 None None] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:00.660911 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eca81b-8be0-4916-8828-3f357e0f0ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:00.660911 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eca81b-8be0-4916-8828-3f357e0f0ed2 None None] PATH_INFO: `/` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:00.662211 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1209/2424] 10.222.0.13 () {54 vars in 921 bytes} [Wed Nov 2 07:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:00.668118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9ddc-cca7-47ec-8b6a-e40e6445e47a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:00.668385 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9ddc-cca7-47ec-8b6a-e40e6445e47a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:00.668686 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9ddc-cca7-47ec-8b6a-e40e6445e47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:00.692972 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-99bd9ddc-cca7-47ec-8b6a-e40e6445e47a None None] MFA Rules not processed for user `ad0826bb58db4100b0d807fb07734deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:00.694205 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-99bd9ddc-cca7-47ec-8b6a-e40e6445e47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:00.802016 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1216/2425] 10.222.0.13 () {58 vars in 1018 bytes} [Wed Nov 2 07:34:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:34:00.815364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eca81b-8be0-4916-8828-3f357e0f0ed2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:00.817295 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-65eca81b-8be0-4916-8828-3f357e0f0ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:00.892705 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eca81b-8be0-4916-8828-3f357e0f0ed2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:00.896567 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bf65e-427e-457e-920e-5d083f4c78af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c27a93c04181493593a069650a977773', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:00.897765 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bf65e-427e-457e-920e-5d083f4c78af service glance] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:00.898124 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bf65e-427e-457e-920e-5d083f4c78af service glance] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:00.898495 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bf65e-427e-457e-920e-5d083f4c78af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:00.913756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bf65e-427e-457e-920e-5d083f4c78af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:00.915322 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bf65e-427e-457e-920e-5d083f4c78af service glance] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:00.928006 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1210/2426] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:34:01.266539 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd9ddc-cca7-47ec-8b6a-e40e6445e47a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:01.269297 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-99bd9ddc-cca7-47ec-8b6a-e40e6445e47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:01.340038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd9ddc-cca7-47ec-8b6a-e40e6445e47a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:01.345718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:01.346318 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:01.346629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:01.346866 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] PATH_INFO: `/v3/users/f1eb3fbaa67748768267466e12da58f8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:01.348293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1eb3fbaa67748768267466e12da58f8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:01.350245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:01.400411 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1eb3fbaa67748768267466e12da58f8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.408134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1eb3fbaa67748768267466e12da58f8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.409118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1eb3fbaa67748768267466e12da58f8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.422246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1eb3fbaa67748768267466e12da58f8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.425513 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:01.436230 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1eb3fbaa67748768267466e12da58f8'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.451616 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1217/2427] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:34:01 2022] DELETE /identity/v3/users/f1eb3fbaa67748768267466e12da58f8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:01.668358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bf65e-427e-457e-920e-5d083f4c78af service glance] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:01.684651 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bf65e-427e-457e-920e-5d083f4c78af service glance] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:01.739939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:01.753166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:01.753805 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:01.754080 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:01.754346 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] PATH_INFO: `/v3/projects/cad8e6386233445c81de8513f803c68f` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:01.755468 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad8e6386233445c81de8513f803c68f)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:01.758571 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:01.807852 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad8e6386233445c81de8513f803c68f', 'request_id': 'req-5f3f6930-b65f-4e85-be2d-97f7db25cf99'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.813259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad8e6386233445c81de8513f803c68f', 'request_id': 'req-5f3f6930-b65f-4e85-be2d-97f7db25cf99'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.819910 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad8e6386233445c81de8513f803c68f', 'request_id': 'req-5f3f6930-b65f-4e85-be2d-97f7db25cf99'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.835010 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] The token cache is being invalidate because project cad8e6386233445c81de8513f803c68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:34:01.835298 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.835931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.837472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1211/2428] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:34:01 2022] DELETE /identity/v3/projects/cad8e6386233445c81de8513f803c68f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:01.841588 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:01.843113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:01.858510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d0cce-6838-43be-90b5-e4781bcb64d3 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:01.926014 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:01.926673 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:01.926923 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:01.927201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] PATH_INFO: `/v3/users/6cc4d21c3f9c44dca5f1aff5778d4ba0` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:01.928337 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc4d21c3f9c44dca5f1aff5778d4ba0)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:01.930447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:01.985021 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc4d21c3f9c44dca5f1aff5778d4ba0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.993455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc4d21c3f9c44dca5f1aff5778d4ba0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:01.994098 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc4d21c3f9c44dca5f1aff5778d4ba0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:02.007838 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc4d21c3f9c44dca5f1aff5778d4ba0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:02.014866 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-84ac7b5c-6a6e-4ddd-bf6e-02c20aa90b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc4d21c3f9c44dca5f1aff5778d4ba0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:02.021649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1218/2429] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:34:01 2022] DELETE /identity/v3/users/6cc4d21c3f9c44dca5f1aff5778d4ba0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:02.207650 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:02.209332 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:02.225855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f6930-b65f-4e85-be2d-97f7db25cf99 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:02.297986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:02.298824 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.299313 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.299685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] PATH_INFO: `/v3/projects/a49d54acd17a481e94cc42395c3c4438` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.301024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49d54acd17a481e94cc42395c3c4438)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:02.302927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:02.357246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49d54acd17a481e94cc42395c3c4438', 'request_id': 'req-408012e8-ac3f-4462-908b-75b5d10a1bad'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:02.363503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49d54acd17a481e94cc42395c3c4438', 'request_id': 'req-408012e8-ac3f-4462-908b-75b5d10a1bad'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:02.370710 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49d54acd17a481e94cc42395c3c4438', 'request_id': 'req-408012e8-ac3f-4462-908b-75b5d10a1bad'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:02.385171 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] The token cache is being invalidate because project a49d54acd17a481e94cc42395c3c4438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:34:02.385506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:02.386143 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-408012e8-ac3f-4462-908b-75b5d10a1bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:02.387766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1212/2430] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:34:02 2022] DELETE /identity/v3/projects/a49d54acd17a481e94cc42395c3c4438 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:34:02.395143 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8810a0-7f85-4b31-961a-1faf102d9a15 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.395498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8810a0-7f85-4b31-961a-1faf102d9a15 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.395837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8810a0-7f85-4b31-961a-1faf102d9a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.418388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-fd8810a0-7f85-4b31-961a-1faf102d9a15 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:02.419584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fd8810a0-7f85-4b31-961a-1faf102d9a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:02.484195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1219/2431] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:02.492150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43261f4-39b1-41ef-bc32-73719be1fb98 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.492259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43261f4-39b1-41ef-bc32-73719be1fb98 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.492445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43261f4-39b1-41ef-bc32-73719be1fb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.512440 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c43261f4-39b1-41ef-bc32-73719be1fb98 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:02.513685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c43261f4-39b1-41ef-bc32-73719be1fb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:02.522137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1213/2432] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:02.526376 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8810a0-7f85-4b31-961a-1faf102d9a15 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:02.536891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8810a0-7f85-4b31-961a-1faf102d9a15 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:02.541492 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e645a3-d448-42f8-a1ad-fa5a452defed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:02.542127 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e645a3-d448-42f8-a1ad-fa5a452defed admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.542401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e645a3-d448-42f8-a1ad-fa5a452defed admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.542667 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e645a3-d448-42f8-a1ad-fa5a452defed admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.543303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e645a3-d448-42f8-a1ad-fa5a452defed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:34:02.543596 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e645a3-d448-42f8-a1ad-fa5a452defed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:02.545193 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e645a3-d448-42f8-a1ad-fa5a452defed admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:02.551830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:02.557498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1220/2433] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:34:02.562102 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43261f4-39b1-41ef-bc32-73719be1fb98 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:02.566731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:02.572725 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43261f4-39b1-41ef-bc32-73719be1fb98 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:02.578187 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af727ae6-6429-434c-95ac-ace5dc3f2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:02.578796 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af727ae6-6429-434c-95ac-ace5dc3f2df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.579073 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af727ae6-6429-434c-95ac-ace5dc3f2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.579339 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af727ae6-6429-434c-95ac-ace5dc3f2df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.580503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af727ae6-6429-434c-95ac-ace5dc3f2df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:02.582424 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af727ae6-6429-434c-95ac-ace5dc3f2df6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:02.609174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1214/2434] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:34:02 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:34:02.613354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e645a3-d448-42f8-a1ad-fa5a452defed admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:02.623856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e645a3-d448-42f8-a1ad-fa5a452defed admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:02.685826 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536db709-8b96-4d85-a290-2f129e897b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:02.686356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db709-8b96-4d85-a290-2f129e897b0a admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.686634 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db709-8b96-4d85-a290-2f129e897b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.686907 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db709-8b96-4d85-a290-2f129e897b0a admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.687549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536db709-8b96-4d85-a290-2f129e897b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:02.689540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536db709-8b96-4d85-a290-2f129e897b0a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:02.717269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1221/2435] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:34:02 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:34:02.718087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af727ae6-6429-434c-95ac-ace5dc3f2df6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:02.730896 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af727ae6-6429-434c-95ac-ace5dc3f2df6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:02.735939 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42896a73-3c35-462a-81cd-488937316859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:02.736545 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42896a73-3c35-462a-81cd-488937316859 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.736817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42896a73-3c35-462a-81cd-488937316859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.737132 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42896a73-3c35-462a-81cd-488937316859 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.738196 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42896a73-3c35-462a-81cd-488937316859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:02.739785 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42896a73-3c35-462a-81cd-488937316859 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:02.763111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1215/2436] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:34:02.768201 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536db709-8b96-4d85-a290-2f129e897b0a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:02.779455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536db709-8b96-4d85-a290-2f129e897b0a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:02.784370 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9425eba-9d2f-4d37-bf6c-3b3ae04d40ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:02.784971 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9425eba-9d2f-4d37-bf6c-3b3ae04d40ae admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.785278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9425eba-9d2f-4d37-bf6c-3b3ae04d40ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.785683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9425eba-9d2f-4d37-bf6c-3b3ae04d40ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.786328 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9425eba-9d2f-4d37-bf6c-3b3ae04d40ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:02.787923 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9425eba-9d2f-4d37-bf6c-3b3ae04d40ae admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:02.801055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1222/2437] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:34:02.805454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42896a73-3c35-462a-81cd-488937316859 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:02.817663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42896a73-3c35-462a-81cd-488937316859 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:02.823037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acefcd7-aece-4117-b059-bc4e8e731ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:02.823695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acefcd7-aece-4117-b059-bc4e8e731ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.823972 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acefcd7-aece-4117-b059-bc4e8e731ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.824253 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acefcd7-aece-4117-b059-bc4e8e731ea0 admin admin] PATH_INFO: `/v3/projects/5ff1d7c6decc42a0ae1cd8592cc836a9/users/43c6c3e436dd4f26a64ec93ba1524a2b/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.844646 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acefcd7-aece-4117-b059-bc4e8e731ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff1d7c6decc42a0ae1cd8592cc836a9, user_id=43c6c3e436dd4f26a64ec93ba1524a2b, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:02.848529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acefcd7-aece-4117-b059-bc4e8e731ea0 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:02.869137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1216/2438] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:34:02 2022] PUT /identity/v3/projects/5ff1d7c6decc42a0ae1cd8592cc836a9/users/43c6c3e436dd4f26a64ec93ba1524a2b/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:02.878741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ade1f1-59c8-4b97-bb7c-b9a055c99521 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:02.878741 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ade1f1-59c8-4b97-bb7c-b9a055c99521 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:02.879018 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ade1f1-59c8-4b97-bb7c-b9a055c99521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:02.922209 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-62ade1f1-59c8-4b97-bb7c-b9a055c99521 None None] MFA Rules not processed for user `43c6c3e436dd4f26a64ec93ba1524a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:02.923671 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-62ade1f1-59c8-4b97-bb7c-b9a055c99521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:03.004222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1223/2439] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:34:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:03.015678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acefcd7-aece-4117-b059-bc4e8e731ea0 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:03.018955 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4acefcd7-aece-4117-b059-bc4e8e731ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:03.109509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acefcd7-aece-4117-b059-bc4e8e731ea0 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:03.114836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d22004-5173-4409-b255-1cce662bad3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:03.115650 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d22004-5173-4409-b255-1cce662bad3d service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:03.116000 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d22004-5173-4409-b255-1cce662bad3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:03.116328 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d22004-5173-4409-b255-1cce662bad3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:03.126043 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d22004-5173-4409-b255-1cce662bad3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:03.127668 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d22004-5173-4409-b255-1cce662bad3d service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:03.138221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1217/2440] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:03.620706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945977-bfdf-4751-b893-4d4a109b1f6f None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:03.621225 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945977-bfdf-4751-b893-4d4a109b1f6f None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:03.621322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945977-bfdf-4751-b893-4d4a109b1f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:03.642493 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-af945977-bfdf-4751-b893-4d4a109b1f6f None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:03.643738 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-af945977-bfdf-4751-b893-4d4a109b1f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:03.699463 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1224/2441] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:34:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:03.712482 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d22004-5173-4409-b255-1cce662bad3d service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:03.713922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a1d22004-5173-4409-b255-1cce662bad3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:03.783304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d22004-5173-4409-b255-1cce662bad3d service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:03.788980 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28779f00-b40b-4906-93f2-2572bffdab01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:03.789615 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28779f00-b40b-4906-93f2-2572bffdab01 service swift] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:03.789900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28779f00-b40b-4906-93f2-2572bffdab01 service swift] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:03.790175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28779f00-b40b-4906-93f2-2572bffdab01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:03.799141 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28779f00-b40b-4906-93f2-2572bffdab01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:03.800781 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28779f00-b40b-4906-93f2-2572bffdab01 service swift] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:03.809572 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1218/2442] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:34:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:34:08.285666 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af945977-bfdf-4751-b893-4d4a109b1f6f None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:08.301950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:08.385390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af945977-bfdf-4751-b893-4d4a109b1f6f None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:08.413807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:08.413961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:08.414213 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:08.414484 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] PATH_INFO: `/v3/users/43c6c3e436dd4f26a64ec93ba1524a2b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:08.415651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c6c3e436dd4f26a64ec93ba1524a2b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:08.417914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:08.488760 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c6c3e436dd4f26a64ec93ba1524a2b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:08.497729 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c6c3e436dd4f26a64ec93ba1524a2b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:08.499321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c6c3e436dd4f26a64ec93ba1524a2b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:08.530402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c6c3e436dd4f26a64ec93ba1524a2b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:08.538481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c6c3e436dd4f26a64ec93ba1524a2b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:08.547512 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1225/2443] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:34:08 2022] DELETE /identity/v3/users/43c6c3e436dd4f26a64ec93ba1524a2b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:08.550017 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950deb7-54a9-4cae-8681-ed631f478170 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:08.550492 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950deb7-54a9-4cae-8681-ed631f478170 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:08.550609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950deb7-54a9-4cae-8681-ed631f478170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:08.575537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-6950deb7-54a9-4cae-8681-ed631f478170 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:08.577045 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6950deb7-54a9-4cae-8681-ed631f478170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:08.616885 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:08.661793 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1219/2444] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:08.671626 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:08.674761 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:08.758830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909d53f-6625-4ad8-9445-44e985002921 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:08.762934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d77f-fcc4-42cf-bf90-58df9cb3d69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:08.763822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d77f-fcc4-42cf-bf90-58df9cb3d69a service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:08.764167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d77f-fcc4-42cf-bf90-58df9cb3d69a service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:08.764443 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d77f-fcc4-42cf-bf90-58df9cb3d69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:08.775510 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041d77f-fcc4-42cf-bf90-58df9cb3d69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:08.776964 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041d77f-fcc4-42cf-bf90-58df9cb3d69a service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:08.801128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1226/2445] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:34:09.294158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950deb7-54a9-4cae-8681-ed631f478170 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:09.296012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6950deb7-54a9-4cae-8681-ed631f478170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:09.310178 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950deb7-54a9-4cae-8681-ed631f478170 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:09.314949 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:09.315587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:09.315869 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:09.316154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] PATH_INFO: `/v3/projects/5ff1d7c6decc42a0ae1cd8592cc836a9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:09.317336 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff1d7c6decc42a0ae1cd8592cc836a9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:09.336626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:09.404104 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff1d7c6decc42a0ae1cd8592cc836a9', 'request_id': 'req-ee721c63-02f3-45df-bac0-578bd4889ce3'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:09.412053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff1d7c6decc42a0ae1cd8592cc836a9', 'request_id': 'req-ee721c63-02f3-45df-bac0-578bd4889ce3'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:09.419942 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff1d7c6decc42a0ae1cd8592cc836a9', 'request_id': 'req-ee721c63-02f3-45df-bac0-578bd4889ce3'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:09.442849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] The token cache is being invalidate because project 5ff1d7c6decc42a0ae1cd8592cc836a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:34:09.443144 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:09.444029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ee721c63-02f3-45df-bac0-578bd4889ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:09.446713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1220/2446] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:34:09 2022] DELETE /identity/v3/projects/5ff1d7c6decc42a0ae1cd8592cc836a9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:09.668858 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d77f-fcc4-42cf-bf90-58df9cb3d69a service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:09.672191 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-7041d77f-fcc4-42cf-bf90-58df9cb3d69a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:09.703485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d77f-fcc4-42cf-bf90-58df9cb3d69a service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:09.769248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:09.810644 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:09.811464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:09.811742 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:09.812181 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] PATH_INFO: `/v3/users/c7bbbbec614b441d8bb6b5f2a0c55218` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:09.813660 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7bbbbec614b441d8bb6b5f2a0c55218)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:09.816276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:09.907655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7bbbbec614b441d8bb6b5f2a0c55218'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:09.926173 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7bbbbec614b441d8bb6b5f2a0c55218'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:09.927148 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7bbbbec614b441d8bb6b5f2a0c55218'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:09.950007 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7bbbbec614b441d8bb6b5f2a0c55218'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:09.960939 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7bbbbec614b441d8bb6b5f2a0c55218'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:09.972009 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1227/2447] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:34:09 2022] DELETE /identity/v3/users/c7bbbbec614b441d8bb6b5f2a0c55218 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:09.974975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fadf4-2b77-4b94-9f3b-a1ce84420754 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:09.975476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fadf4-2b77-4b94-9f3b-a1ce84420754 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:09.975789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fadf4-2b77-4b94-9f3b-a1ce84420754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:10.007442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-517fadf4-2b77-4b94-9f3b-a1ce84420754 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:10.008682 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-517fadf4-2b77-4b94-9f3b-a1ce84420754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:10.083011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1221/2448] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:34:10.092803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:10.094480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:10.175637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fadf4-2b77-4b94-9f3b-a1ce84420754 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:10.177188 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-517fadf4-2b77-4b94-9f3b-a1ce84420754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:10.203891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f94e0-d5fa-4c01-ab21-6154bab2cdd4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:10.210623 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594244-f3eb-42f8-aae9-a1efb7215527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:10.212850 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594244-f3eb-42f8-aae9-a1efb7215527 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:10.217746 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594244-f3eb-42f8-aae9-a1efb7215527 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:10.218163 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594244-f3eb-42f8-aae9-a1efb7215527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:10.235479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b594244-f3eb-42f8-aae9-a1efb7215527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:10.238326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b594244-f3eb-42f8-aae9-a1efb7215527 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:10.262267 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1228/2449] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:10.292517 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:10.329590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fadf4-2b77-4b94-9f3b-a1ce84420754 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:10.348509 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2d63b-87aa-4a37-bc4e-c1dd3b08652d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:10.349872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d63b-87aa-4a37-bc4e-c1dd3b08652d service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:10.350402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d63b-87aa-4a37-bc4e-c1dd3b08652d service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:10.350948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d63b-87aa-4a37-bc4e-c1dd3b08652d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:10.354442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-f5e2d63b-87aa-4a37-bc4e-c1dd3b08652d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:10.373965 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2d63b-87aa-4a37-bc4e-c1dd3b08652d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:10.376882 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2d63b-87aa-4a37-bc4e-c1dd3b08652d service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:10.399167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1222/2450] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:10.772499 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594244-f3eb-42f8-aae9-a1efb7215527 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:10.774245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3b594244-f3eb-42f8-aae9-a1efb7215527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:10.804202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594244-f3eb-42f8-aae9-a1efb7215527 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:10.811651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:10.811651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:10.811651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:10.811651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] PATH_INFO: `/v3/projects/6cd7ae2b10db43cbb308eaac2160471c` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:10.813396 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd7ae2b10db43cbb308eaac2160471c)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:10.816310 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:10.872426 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd7ae2b10db43cbb308eaac2160471c', 'request_id': 'req-3622fba5-6603-429b-b5f0-139149fd2529'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:10.874141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:10.882153 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd7ae2b10db43cbb308eaac2160471c', 'request_id': 'req-3622fba5-6603-429b-b5f0-139149fd2529'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:10.889246 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd7ae2b10db43cbb308eaac2160471c', 'request_id': 'req-3622fba5-6603-429b-b5f0-139149fd2529'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:10.901600 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] The token cache is being invalidate because project 6cd7ae2b10db43cbb308eaac2160471c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:34:10.901885 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:10.902543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:10.904090 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1229/2451] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:34:10 2022] DELETE /identity/v3/projects/6cd7ae2b10db43cbb308eaac2160471c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:19.236752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2d63b-87aa-4a37-bc4e-c1dd3b08652d service nova] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:19.247163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2d63b-87aa-4a37-bc4e-c1dd3b08652d service nova] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:19.295332 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a8474-069f-462b-b15e-6145d905e199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:19.295933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a8474-069f-462b-b15e-6145d905e199 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:19.296213 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a8474-069f-462b-b15e-6145d905e199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:19.296515 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a8474-069f-462b-b15e-6145d905e199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:19.298382 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c23a8474-069f-462b-b15e-6145d905e199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:19.363126 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a8474-069f-462b-b15e-6145d905e199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:19.364550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a8474-069f-462b-b15e-6145d905e199 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:19.374372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1223/2452] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:20.233089 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:20.234651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:20.328779 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622fba5-6603-429b-b5f0-139149fd2529 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:20.333901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9684e92-43f8-40b5-a916-a3a2b6060090 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:20.334507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9684e92-43f8-40b5-a916-a3a2b6060090 service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:20.334783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9684e92-43f8-40b5-a916-a3a2b6060090 service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:20.335052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9684e92-43f8-40b5-a916-a3a2b6060090 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:20.336764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f9684e92-43f8-40b5-a916-a3a2b6060090 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:20.349520 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9684e92-43f8-40b5-a916-a3a2b6060090 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:20.351113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9684e92-43f8-40b5-a916-a3a2b6060090 service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:20.361121 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1230/2453] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:34:21.153514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ecf5d-da92-4cd3-9115-0e5cef630cbb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:21.154035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ecf5d-da92-4cd3-9115-0e5cef630cbb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:21.154035 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ecf5d-da92-4cd3-9115-0e5cef630cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:21.174851 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5a8ecf5d-da92-4cd3-9115-0e5cef630cbb None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:21.176070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5a8ecf5d-da92-4cd3-9115-0e5cef630cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:21.234395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1224/2454] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:21.247208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9684e92-43f8-40b5-a916-a3a2b6060090 service placement] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:21.248702 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f9684e92-43f8-40b5-a916-a3a2b6060090 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:21.321155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9684e92-43f8-40b5-a916-a3a2b6060090 service placement] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:21.326214 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0201-97db-4549-99e8-0e787a6ce0c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:21.326824 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0201-97db-4549-99e8-0e787a6ce0c4 service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:21.327142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0201-97db-4549-99e8-0e787a6ce0c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:21.327412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0201-97db-4549-99e8-0e787a6ce0c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:21.336194 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d0201-97db-4549-99e8-0e787a6ce0c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:21.337830 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d0201-97db-4549-99e8-0e787a6ce0c4 service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:21.347498 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1231/2455] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:34:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:34:24.023114 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ecf5d-da92-4cd3-9115-0e5cef630cbb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:24.024652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5a8ecf5d-da92-4cd3-9115-0e5cef630cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:24.041050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ecf5d-da92-4cd3-9115-0e5cef630cbb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:24.045822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:24.046450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:24.046723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:24.046989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] PATH_INFO: `/v3/users/8f0df868bfde4164bb2b8f79849516d8` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:24.049167 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0df868bfde4164bb2b8f79849516d8)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:24.051700 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:24.106647 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:24.118923 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0df868bfde4164bb2b8f79849516d8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.119612 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0df868bfde4164bb2b8f79849516d8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.127585 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0df868bfde4164bb2b8f79849516d8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.128231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0df868bfde4164bb2b8f79849516d8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.141655 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0df868bfde4164bb2b8f79849516d8'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.160084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1225/2456] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:34:24 2022] DELETE /identity/v3/users/8f0df868bfde4164bb2b8f79849516d8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:24.329522 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0201-97db-4549-99e8-0e787a6ce0c4 service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:24.345995 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0201-97db-4549-99e8-0e787a6ce0c4 service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:24.398063 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:24.404708 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:24.405687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:24.406097 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:24.406429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] PATH_INFO: `/v3/projects/86cbadf9f51c4bc5ad053c5d34534928` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:24.407735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86cbadf9f51c4bc5ad053c5d34534928)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:24.410903 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:24.459135 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86cbadf9f51c4bc5ad053c5d34534928', 'request_id': 'req-4542bc79-48a2-4629-99ee-3895d187e488'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.467341 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86cbadf9f51c4bc5ad053c5d34534928', 'request_id': 'req-4542bc79-48a2-4629-99ee-3895d187e488'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.476962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86cbadf9f51c4bc5ad053c5d34534928', 'request_id': 'req-4542bc79-48a2-4629-99ee-3895d187e488'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.488535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] The token cache is being invalidate because project 86cbadf9f51c4bc5ad053c5d34534928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:34:24.488819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.489504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.490985 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1232/2457] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:34:24 2022] DELETE /identity/v3/projects/86cbadf9f51c4bc5ad053c5d34534928 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:24.495027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:24.496504 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:24.510489 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a35d9f-5280-4d72-9f3f-bbb8130f7fad admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:24.567366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:24.567985 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:24.568259 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:24.568527 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] PATH_INFO: `/v3/users/516b908b95c043cbbae6583e8e599179` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:24.569661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] RBAC: Authorizing `identity:delete_user(user_id=516b908b95c043cbbae6583e8e599179)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:24.571544 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:24.616800 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516b908b95c043cbbae6583e8e599179'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.617381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516b908b95c043cbbae6583e8e599179'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.624115 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516b908b95c043cbbae6583e8e599179'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.624737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516b908b95c043cbbae6583e8e599179'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.636505 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516b908b95c043cbbae6583e8e599179'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.648441 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1226/2458] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:34:24 2022] DELETE /identity/v3/users/516b908b95c043cbbae6583e8e599179 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:24.821351 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:24.822786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:24.836629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542bc79-48a2-4629-99ee-3895d187e488 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:24.893946 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:24.894483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:24.894798 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:24.895076 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] PATH_INFO: `/v3/projects/ca176b27269a4b678306733635c08d0d` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:24.896179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca176b27269a4b678306733635c08d0d)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:24.898109 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:24.943872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca176b27269a4b678306733635c08d0d', 'request_id': 'req-df56ff2f-8567-4296-9523-1ace59783552'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.951228 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca176b27269a4b678306733635c08d0d', 'request_id': 'req-df56ff2f-8567-4296-9523-1ace59783552'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.957352 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca176b27269a4b678306733635c08d0d', 'request_id': 'req-df56ff2f-8567-4296-9523-1ace59783552'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.968269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] The token cache is being invalidate because project ca176b27269a4b678306733635c08d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:34:24.968555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.969225 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-df56ff2f-8567-4296-9523-1ace59783552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:34:24.970805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1233/2459] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:34:24 2022] DELETE /identity/v3/projects/ca176b27269a4b678306733635c08d0d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:34:34.645066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=68,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:34.965142 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=76,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:56.966147 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:56.967641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:57.120451 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a437069-4100-43d8-b9fd-a395b0d2056d admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:57.179652 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2afa21-913b-48da-b42a-15b16919cb43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:57.180257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2afa21-913b-48da-b42a-15b16919cb43 service placement] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:57.181685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2afa21-913b-48da-b42a-15b16919cb43 service placement] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:57.181962 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2afa21-913b-48da-b42a-15b16919cb43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:57.183820 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-db2afa21-913b-48da-b42a-15b16919cb43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:57.196304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2afa21-913b-48da-b42a-15b16919cb43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:57.197918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2afa21-913b-48da-b42a-15b16919cb43 service placement] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:57.208386 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1227/2460] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:59.759974 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbecaa4-c859-4e2e-8ff0-cb44f8123a70 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:59.760482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbecaa4-c859-4e2e-8ff0-cb44f8123a70 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:59.760482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbecaa4-c859-4e2e-8ff0-cb44f8123a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:59.780094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9fbecaa4-c859-4e2e-8ff0-cb44f8123a70 None None] MFA Rules not processed for user `41f160ae0e09481594bad75cb84e9a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:59.781302 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9fbecaa4-c859-4e2e-8ff0-cb44f8123a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:59.835187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1234/2461] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:34:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:07.203892 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:09.827979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=25 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:55.920526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57378b0-4837-4277-b4df-a21e67c3306c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:55.921070 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57378b0-4837-4277-b4df-a21e67c3306c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:55.921182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57378b0-4837-4277-b4df-a21e67c3306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:55.952666 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-e57378b0-4837-4277-b4df-a21e67c3306c None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:55.953933 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-e57378b0-4837-4277-b4df-a21e67c3306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:56.018881 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1228/2462] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:35:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:56.066966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbecaa4-c859-4e2e-8ff0-cb44f8123a70 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:56.068393 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9fbecaa4-c859-4e2e-8ff0-cb44f8123a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:56.151162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbecaa4-c859-4e2e-8ff0-cb44f8123a70 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:56.156955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8342525-6f04-4d15-a2a1-7673680db459 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:56.157697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342525-6f04-4d15-a2a1-7673680db459 service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:56.157978 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342525-6f04-4d15-a2a1-7673680db459 service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:56.158323 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342525-6f04-4d15-a2a1-7673680db459 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:56.169222 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8342525-6f04-4d15-a2a1-7673680db459 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:56.170913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8342525-6f04-4d15-a2a1-7673680db459 service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:56.184349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1235/2463] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:35:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:36:06.011471 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=32 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:06.178903 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=32 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:11.055041 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259b67a-6e9c-4e95-a632-5d0a8883def5 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:11.055535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259b67a-6e9c-4e95-a632-5d0a8883def5 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:11.055639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259b67a-6e9c-4e95-a632-5d0a8883def5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:11.074711 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b259b67a-6e9c-4e95-a632-5d0a8883def5 None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:11.075907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b259b67a-6e9c-4e95-a632-5d0a8883def5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:11.083184 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1229/2464] 10.222.0.13 () {58 vars in 1009 bytes} [Wed Nov 2 07:36:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:11.095667 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8342525-6f04-4d15-a2a1-7673680db459 service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:11.106774 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8342525-6f04-4d15-a2a1-7673680db459 service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:11.111693 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57e8b-6890-47b1-af32-5fd2cbaa772b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:11.112271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57e8b-6890-47b1-af32-5fd2cbaa772b service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:11.112543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57e8b-6890-47b1-af32-5fd2cbaa772b service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:11.112810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57e8b-6890-47b1-af32-5fd2cbaa772b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:11.120682 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade57e8b-6890-47b1-af32-5fd2cbaa772b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:11.122192 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade57e8b-6890-47b1-af32-5fd2cbaa772b service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:11.130118 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1236/2465] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:36:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:36:21.069622 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:21.127019 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:27.937723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4add5-ca06-4a09-bbb7-8a764c463fc1 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:27.938202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4add5-ca06-4a09-bbb7-8a764c463fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:27.938310 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4add5-ca06-4a09-bbb7-8a764c463fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:27.957522 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-cee4add5-ca06-4a09-bbb7-8a764c463fc1 None None] MFA Rules not processed for user `e27f655402804b439fb23a3a983a1c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:36:27.958715 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cee4add5-ca06-4a09-bbb7-8a764c463fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:36:27.966738 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1230/2466] 10.222.0.13 () {58 vars in 967 bytes} [Wed Nov 2 07:36:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:36:27.979263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57e8b-6890-47b1-af32-5fd2cbaa772b service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:36:27.989657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57e8b-6890-47b1-af32-5fd2cbaa772b service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:36:27.994521 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa0733-27d5-47df-bc3c-2a8ed83164db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80d3e8c42ab4942b32618db3f19dd88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:36:27.995101 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa0733-27d5-47df-bc3c-2a8ed83164db service swift] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:36:27.995375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa0733-27d5-47df-bc3c-2a8ed83164db service swift] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:36:27.995645 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa0733-27d5-47df-bc3c-2a8ed83164db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:36:28.003518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa0733-27d5-47df-bc3c-2a8ed83164db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:36:28.005103 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa0733-27d5-47df-bc3c-2a8ed83164db service swift] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:36:28.013759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1237/2467] 10.222.0.13 () {60 vars in 1384 bytes} [Wed Nov 2 07:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:36:37.952599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:38.010419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:00.539309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4add5-ca06-4a09-bbb7-8a764c463fc1 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:00.540708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-cee4add5-ca06-4a09-bbb7-8a764c463fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:00.617701 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4add5-ca06-4a09-bbb7-8a764c463fc1 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:00.621810 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257055df-2d77-4a66-9dc3-8cc39c77a9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:00.622402 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257055df-2d77-4a66-9dc3-8cc39c77a9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:00.622678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257055df-2d77-4a66-9dc3-8cc39c77a9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:00.622946 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257055df-2d77-4a66-9dc3-8cc39c77a9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:00.624678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-257055df-2d77-4a66-9dc3-8cc39c77a9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:00.707479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257055df-2d77-4a66-9dc3-8cc39c77a9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:00.708897 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257055df-2d77-4a66-9dc3-8cc39c77a9f5 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:00.729401 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1231/2468] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:01.915339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa0733-27d5-47df-bc3c-2a8ed83164db service swift] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:01.916771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-effa0733-27d5-47df-bc3c-2a8ed83164db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:01.928985 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa0733-27d5-47df-bc3c-2a8ed83164db service swift] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:01.932519 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d1779-532f-4dd8-b217-0b5471e56125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:01.933637 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1779-532f-4dd8-b217-0b5471e56125 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:01.933911 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1779-532f-4dd8-b217-0b5471e56125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:01.934438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1779-532f-4dd8-b217-0b5471e56125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:01.936138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-174d1779-532f-4dd8-b217-0b5471e56125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:01.950382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d1779-532f-4dd8-b217-0b5471e56125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:01.951785 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d1779-532f-4dd8-b217-0b5471e56125 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:01.963038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1238/2469] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:10.726813 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=72 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:11.462063 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257055df-2d77-4a66-9dc3-8cc39c77a9f5 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:11.463639 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-257055df-2d77-4a66-9dc3-8cc39c77a9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:11.478488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257055df-2d77-4a66-9dc3-8cc39c77a9f5 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:11.483853 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500bd05-7528-49aa-91e8-e45d57f64ecb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:11.484462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500bd05-7528-49aa-91e8-e45d57f64ecb service placement] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:11.484740 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500bd05-7528-49aa-91e8-e45d57f64ecb service placement] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:11.485025 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500bd05-7528-49aa-91e8-e45d57f64ecb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:11.487283 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-6500bd05-7528-49aa-91e8-e45d57f64ecb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:11.501496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500bd05-7528-49aa-91e8-e45d57f64ecb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:11.501496 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500bd05-7528-49aa-91e8-e45d57f64ecb service placement] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:11.511122 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1232/2470] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:11.529683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d1779-532f-4dd8-b217-0b5471e56125 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:11.531112 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-174d1779-532f-4dd8-b217-0b5471e56125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:11.637805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d1779-532f-4dd8-b217-0b5471e56125 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:11.642303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:11.642919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:11.643187 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:11.643453 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] PATH_INFO: `/v3/users/41f160ae0e09481594bad75cb84e9a5b` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:11.644552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f160ae0e09481594bad75cb84e9a5b)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:11.646466 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:11.692256 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f160ae0e09481594bad75cb84e9a5b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:11.699390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f160ae0e09481594bad75cb84e9a5b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:11.700419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f160ae0e09481594bad75cb84e9a5b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:11.712465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f160ae0e09481594bad75cb84e9a5b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:11.719481 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3786ef1f-1fcc-4314-94e4-3c3cd2974132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f160ae0e09481594bad75cb84e9a5b'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:11.726128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1239/2471] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:11 2022] DELETE /identity/v3/users/41f160ae0e09481594bad75cb84e9a5b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:11.893970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500bd05-7528-49aa-91e8-e45d57f64ecb service placement] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:11.911156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500bd05-7528-49aa-91e8-e45d57f64ecb service placement] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:11.969429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:11.969991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:11.970268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:11.970531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] PATH_INFO: `/v3/projects/0ec78dbcb3e746a48935acfe240cc4cf` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:11.971637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec78dbcb3e746a48935acfe240cc4cf)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:11.973812 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:12.018418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec78dbcb3e746a48935acfe240cc4cf', 'request_id': 'req-bf699359-a3ea-436a-a496-354340071568'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:12.023837 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec78dbcb3e746a48935acfe240cc4cf', 'request_id': 'req-bf699359-a3ea-436a-a496-354340071568'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:12.030536 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec78dbcb3e746a48935acfe240cc4cf', 'request_id': 'req-bf699359-a3ea-436a-a496-354340071568'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:12.042841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] The token cache is being invalidate because project 0ec78dbcb3e746a48935acfe240cc4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:12.043169 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:12.043916 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-bf699359-a3ea-436a-a496-354340071568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:12.045400 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1233/2472] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:11 2022] DELETE /identity/v3/projects/0ec78dbcb3e746a48935acfe240cc4cf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:37:12.050355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebcfb-e238-483c-86f5-3e50eafe7efa None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:12.050625 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebcfb-e238-483c-86f5-3e50eafe7efa None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:12.050891 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebcfb-e238-483c-86f5-3e50eafe7efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:12.107460 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:12.111105 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-033ebcfb-e238-483c-86f5-3e50eafe7efa None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:12.113159 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-033ebcfb-e238-483c-86f5-3e50eafe7efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:12.172361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1240/2473] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:37:12.180384 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425f8a4-2558-4eea-8850-8315546a44a2 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:12.180662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425f8a4-2558-4eea-8850-8315546a44a2 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:12.180961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425f8a4-2558-4eea-8850-8315546a44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:12.202238 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-7425f8a4-2558-4eea-8850-8315546a44a2 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:12.203453 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-7425f8a4-2558-4eea-8850-8315546a44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:12.211743 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1234/2474] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:12.216923 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ebcfb-e238-483c-86f5-3e50eafe7efa None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:12.227285 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ebcfb-e238-483c-86f5-3e50eafe7efa None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:12.232106 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf165c7-16d0-4aee-be5f-ad8a3fdda1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:12.232702 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf165c7-16d0-4aee-be5f-ad8a3fdda1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:12.232977 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf165c7-16d0-4aee-be5f-ad8a3fdda1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:12.233273 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf165c7-16d0-4aee-be5f-ad8a3fdda1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:12.233943 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf165c7-16d0-4aee-be5f-ad8a3fdda1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:37:12.234241 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf165c7-16d0-4aee-be5f-ad8a3fdda1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:12.235818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf165c7-16d0-4aee-be5f-ad8a3fdda1a2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:12.247326 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1241/2475] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:37:12.251674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425f8a4-2558-4eea-8850-8315546a44a2 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:12.260914 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425f8a4-2558-4eea-8850-8315546a44a2 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:12.266857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26fa6d-4b64-4f62-b013-c0ea8bd2da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:12.267446 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26fa6d-4b64-4f62-b013-c0ea8bd2da2a admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:12.267718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26fa6d-4b64-4f62-b013-c0ea8bd2da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:12.267982 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26fa6d-4b64-4f62-b013-c0ea8bd2da2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:12.268609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26fa6d-4b64-4f62-b013-c0ea8bd2da2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:12.270535 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26fa6d-4b64-4f62-b013-c0ea8bd2da2a admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:12.306870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1235/2476] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:12 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:12.311113 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf165c7-16d0-4aee-be5f-ad8a3fdda1a2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:12.321275 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf165c7-16d0-4aee-be5f-ad8a3fdda1a2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:12.377315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e959df1-4f75-4787-89fc-d237c878798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:12.377949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e959df1-4f75-4787-89fc-d237c878798b admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:12.378223 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e959df1-4f75-4787-89fc-d237c878798b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:12.378491 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e959df1-4f75-4787-89fc-d237c878798b admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:12.379107 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e959df1-4f75-4787-89fc-d237c878798b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:12.381051 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e959df1-4f75-4787-89fc-d237c878798b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:12.402684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1242/2477] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:12 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:12.406922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26fa6d-4b64-4f62-b013-c0ea8bd2da2a admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:12.417420 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26fa6d-4b64-4f62-b013-c0ea8bd2da2a admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:12.422186 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b10f9e-eac2-4b8c-96ed-f847e3fc2978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:12.422777 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10f9e-eac2-4b8c-96ed-f847e3fc2978 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:12.423052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10f9e-eac2-4b8c-96ed-f847e3fc2978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:12.423321 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10f9e-eac2-4b8c-96ed-f847e3fc2978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:12.423956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b10f9e-eac2-4b8c-96ed-f847e3fc2978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:12.425557 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b10f9e-eac2-4b8c-96ed-f847e3fc2978 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:12.436183 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1236/2478] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:12.439986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e959df1-4f75-4787-89fc-d237c878798b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:12.450390 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e959df1-4f75-4787-89fc-d237c878798b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:12.454934 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dd8d3-4090-43e1-b4d5-fa45783ea15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:12.455515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dd8d3-4090-43e1-b4d5-fa45783ea15a admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:12.455786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dd8d3-4090-43e1-b4d5-fa45783ea15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:12.456055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dd8d3-4090-43e1-b4d5-fa45783ea15a admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:12.456680 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dd8d3-4090-43e1-b4d5-fa45783ea15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:12.458287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dd8d3-4090-43e1-b4d5-fa45783ea15a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:12.468721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1243/2479] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:12.473266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b10f9e-eac2-4b8c-96ed-f847e3fc2978 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:12.483376 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b10f9e-eac2-4b8c-96ed-f847e3fc2978 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:12.487986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebee6b-e266-443d-9c6b-88be35944347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:12.488653 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebee6b-e266-443d-9c6b-88be35944347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:12.488928 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebee6b-e266-443d-9c6b-88be35944347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:12.489228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebee6b-e266-443d-9c6b-88be35944347 admin admin] PATH_INFO: `/v3/projects/cd8effc140314c43a7d98f34ee0a79f9/users/681811d84ce14ce9bdcc216ac51c7239/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:12.505136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebee6b-e266-443d-9c6b-88be35944347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8effc140314c43a7d98f34ee0a79f9, user_id=681811d84ce14ce9bdcc216ac51c7239, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:12.507872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebee6b-e266-443d-9c6b-88be35944347 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:12.523236 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1237/2480] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:12 2022] PUT /identity/v3/projects/cd8effc140314c43a7d98f34ee0a79f9/users/681811d84ce14ce9bdcc216ac51c7239/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:12.535603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd1c66-5ae9-408e-ae08-055c3a294ec7 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:12.536601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd1c66-5ae9-408e-ae08-055c3a294ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:12.536872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd1c66-5ae9-408e-ae08-055c3a294ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:12.566471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4cfd1c66-5ae9-408e-ae08-055c3a294ec7 None None] MFA Rules not processed for user `681811d84ce14ce9bdcc216ac51c7239`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:12.567706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4cfd1c66-5ae9-408e-ae08-055c3a294ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:12.634202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1244/2481] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:12.645503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebee6b-e266-443d-9c6b-88be35944347 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:12.647226 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-dcebee6b-e266-443d-9c6b-88be35944347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:12.654695 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:12.724364 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebee6b-e266-443d-9c6b-88be35944347 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:12.729907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c585e5-2d47-4bd5-b41f-73ec120d5a2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad0826bb58db4100b0d807fb07734deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:12.731028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c585e5-2d47-4bd5-b41f-73ec120d5a2c service nova] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:12.731395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c585e5-2d47-4bd5-b41f-73ec120d5a2c service nova] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:12.731676 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c585e5-2d47-4bd5-b41f-73ec120d5a2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:12.739379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c585e5-2d47-4bd5-b41f-73ec120d5a2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:12.740893 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c585e5-2d47-4bd5-b41f-73ec120d5a2c service nova] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:12.750150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1238/2482] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:15.421921 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd1c66-5ae9-408e-ae08-055c3a294ec7 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:15.424961 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:15.486458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd1c66-5ae9-408e-ae08-055c3a294ec7 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:15.491162 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:15.491783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:15.492059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:15.492357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] PATH_INFO: `/v3/users/681811d84ce14ce9bdcc216ac51c7239` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:15.493537 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] RBAC: Authorizing `identity:delete_user(user_id=681811d84ce14ce9bdcc216ac51c7239)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:15.495462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:15.540289 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681811d84ce14ce9bdcc216ac51c7239'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:15.548349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681811d84ce14ce9bdcc216ac51c7239'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:15.548992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681811d84ce14ce9bdcc216ac51c7239'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:15.561189 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681811d84ce14ce9bdcc216ac51c7239'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:15.568568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681811d84ce14ce9bdcc216ac51c7239'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:15.574378 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1245/2483] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:15 2022] DELETE /identity/v3/users/681811d84ce14ce9bdcc216ac51c7239 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:15.578904 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d8af4-84db-4549-b737-d872a7988c98 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:15.579439 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d8af4-84db-4549-b737-d872a7988c98 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:15.579565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d8af4-84db-4549-b737-d872a7988c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:15.600825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-5c4d8af4-84db-4549-b737-d872a7988c98 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:15.602079 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5c4d8af4-84db-4549-b737-d872a7988c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:15.660089 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1239/2484] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:15.670383 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:15.671851 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:15.731140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356662d-44b0-4ca5-b4b2-6857a071dfba admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:15.734935 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb6253-7ee4-4c60-9947-2f0752da2ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:15.735531 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb6253-7ee4-4c60-9947-2f0752da2ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:15.735807 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb6253-7ee4-4c60-9947-2f0752da2ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:15.736072 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb6253-7ee4-4c60-9947-2f0752da2ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:15.744840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb6253-7ee4-4c60-9947-2f0752da2ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:15.746292 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb6253-7ee4-4c60-9947-2f0752da2ca4 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:15.756654 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1246/2485] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:16.029058 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d8af4-84db-4549-b737-d872a7988c98 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.030644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-5c4d8af4-84db-4549-b737-d872a7988c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:16.044662 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d8af4-84db-4549-b737-d872a7988c98 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.049445 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.050101 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.050383 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.050657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] PATH_INFO: `/v3/projects/cd8effc140314c43a7d98f34ee0a79f9` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.051784 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8effc140314c43a7d98f34ee0a79f9)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.053721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.107841 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8effc140314c43a7d98f34ee0a79f9', 'request_id': 'req-87346722-7add-4e6a-925c-d0e75562c2cf'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:16.113624 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8effc140314c43a7d98f34ee0a79f9', 'request_id': 'req-87346722-7add-4e6a-925c-d0e75562c2cf'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:16.120049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8effc140314c43a7d98f34ee0a79f9', 'request_id': 'req-87346722-7add-4e6a-925c-d0e75562c2cf'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:16.133621 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] The token cache is being invalidate because project cd8effc140314c43a7d98f34ee0a79f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:16.133914 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:16.134525 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-87346722-7add-4e6a-925c-d0e75562c2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:16.135986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1240/2486] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:16 2022] DELETE /identity/v3/projects/cd8effc140314c43a7d98f34ee0a79f9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:16.141571 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf17d-698f-4c3c-bf13-197b0fb27e3a None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.141876 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf17d-698f-4c3c-bf13-197b0fb27e3a None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.142145 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf17d-698f-4c3c-bf13-197b0fb27e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.162733 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-f8ecf17d-698f-4c3c-bf13-197b0fb27e3a None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:16.163951 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-f8ecf17d-698f-4c3c-bf13-197b0fb27e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:16.184660 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:16.226190 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1247/2487] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:16.234817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c21d7-d557-4d2c-bdae-e3ff5f83d7cb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.235098 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c21d7-d557-4d2c-bdae-e3ff5f83d7cb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.235372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c21d7-d557-4d2c-bdae-e3ff5f83d7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.255596 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-aa6c21d7-d557-4d2c-bdae-e3ff5f83d7cb None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:16.256836 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-aa6c21d7-d557-4d2c-bdae-e3ff5f83d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:16.264791 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1241/2488] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:16.268917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecf17d-698f-4c3c-bf13-197b0fb27e3a None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.279117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecf17d-698f-4c3c-bf13-197b0fb27e3a None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.283757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3ec4-ff21-4bd6-a1be-c35d8803589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.284339 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3ec4-ff21-4bd6-a1be-c35d8803589b admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.284610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3ec4-ff21-4bd6-a1be-c35d8803589b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.284874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3ec4-ff21-4bd6-a1be-c35d8803589b admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.285545 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3ec4-ff21-4bd6-a1be-c35d8803589b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:37:16.285870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3ec4-ff21-4bd6-a1be-c35d8803589b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.287424 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3ec4-ff21-4bd6-a1be-c35d8803589b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.298657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1248/2489] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:37:16.302776 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c21d7-d557-4d2c-bdae-e3ff5f83d7cb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.312617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c21d7-d557-4d2c-bdae-e3ff5f83d7cb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.317191 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49a4e9-9de0-432d-a438-5281b6aa10b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.317767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49a4e9-9de0-432d-a438-5281b6aa10b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.318039 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49a4e9-9de0-432d-a438-5281b6aa10b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.318307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49a4e9-9de0-432d-a438-5281b6aa10b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.318929 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49a4e9-9de0-432d-a438-5281b6aa10b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.320792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49a4e9-9de0-432d-a438-5281b6aa10b5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.325429 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:16.350960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1242/2490] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:16 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:37:16.355050 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3ec4-ff21-4bd6-a1be-c35d8803589b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.365648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3ec4-ff21-4bd6-a1be-c35d8803589b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.421917 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5db45-b7ee-4e6b-901d-6ebf4a86cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.422610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5db45-b7ee-4e6b-901d-6ebf4a86cd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.422768 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5db45-b7ee-4e6b-901d-6ebf4a86cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.423031 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5db45-b7ee-4e6b-901d-6ebf4a86cd1d admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.423651 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5db45-b7ee-4e6b-901d-6ebf4a86cd1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.425564 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5db45-b7ee-4e6b-901d-6ebf4a86cd1d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.446633 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1249/2491] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:16 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:16.451391 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49a4e9-9de0-432d-a438-5281b6aa10b5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.461524 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49a4e9-9de0-432d-a438-5281b6aa10b5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.466182 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf90b8-f8f2-4ba2-9ba9-083304f8e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.466764 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf90b8-f8f2-4ba2-9ba9-083304f8e377 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.467037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf90b8-f8f2-4ba2-9ba9-083304f8e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.467301 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf90b8-f8f2-4ba2-9ba9-083304f8e377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.467921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf90b8-f8f2-4ba2-9ba9-083304f8e377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.469724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf90b8-f8f2-4ba2-9ba9-083304f8e377 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.479817 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1243/2492] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:16.484472 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5db45-b7ee-4e6b-901d-6ebf4a86cd1d admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.494283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5db45-b7ee-4e6b-901d-6ebf4a86cd1d admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.499567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb394e-5a75-45d0-bcce-7313dab8fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.500149 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb394e-5a75-45d0-bcce-7313dab8fa8c admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.500423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb394e-5a75-45d0-bcce-7313dab8fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.500691 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb394e-5a75-45d0-bcce-7313dab8fa8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.501354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb394e-5a75-45d0-bcce-7313dab8fa8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.502923 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb394e-5a75-45d0-bcce-7313dab8fa8c admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.513543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1250/2493] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:16.517661 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf90b8-f8f2-4ba2-9ba9-083304f8e377 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.527433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf90b8-f8f2-4ba2-9ba9-083304f8e377 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.532074 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f017b5-ab34-4116-b9d5-6d4be952167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.532731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f017b5-ab34-4116-b9d5-6d4be952167f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.533029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f017b5-ab34-4116-b9d5-6d4be952167f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.533305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f017b5-ab34-4116-b9d5-6d4be952167f admin admin] PATH_INFO: `/v3/projects/1283c375902743f9b820eefd2058d3ae/users/6df968df017f4fffb9b96c84eb17cbe6/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.547829 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f017b5-ab34-4116-b9d5-6d4be952167f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1283c375902743f9b820eefd2058d3ae, user_id=6df968df017f4fffb9b96c84eb17cbe6, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.550493 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f017b5-ab34-4116-b9d5-6d4be952167f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.563824 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1244/2494] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:16 2022] PUT /identity/v3/projects/1283c375902743f9b820eefd2058d3ae/users/6df968df017f4fffb9b96c84eb17cbe6/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:16.574286 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6668d-16f7-4257-ac0b-91b3409d5e73 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.574570 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6668d-16f7-4257-ac0b-91b3409d5e73 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.574866 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6668d-16f7-4257-ac0b-91b3409d5e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.601966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-fbb6668d-16f7-4257-ac0b-91b3409d5e73 None None] MFA Rules not processed for user `6df968df017f4fffb9b96c84eb17cbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:16.603167 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fbb6668d-16f7-4257-ac0b-91b3409d5e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:16.666172 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1251/2495] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:16.671305 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f017b5-ab34-4116-b9d5-6d4be952167f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.732823 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f017b5-ab34-4116-b9d5-6d4be952167f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.737447 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b59d1c-375e-4278-8109-c3e5a31a8a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.738040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59d1c-375e-4278-8109-c3e5a31a8a09 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.738317 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59d1c-375e-4278-8109-c3e5a31a8a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.738587 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b59d1c-375e-4278-8109-c3e5a31a8a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.739218 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b59d1c-375e-4278-8109-c3e5a31a8a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.741121 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b59d1c-375e-4278-8109-c3e5a31a8a09 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.767890 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1245/2496] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:16 2022] POST /identity/v3/projects => generated 403 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:16.772196 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6668d-16f7-4257-ac0b-91b3409d5e73 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.782989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6668d-16f7-4257-ac0b-91b3409d5e73 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.799723 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:16.840217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3298-251a-4174-b98e-f0665eb5a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.840892 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3298-251a-4174-b98e-f0665eb5a6fc admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.841207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3298-251a-4174-b98e-f0665eb5a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.841476 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3298-251a-4174-b98e-f0665eb5a6fc admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.842104 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e3298-251a-4174-b98e-f0665eb5a6fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.843999 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e3298-251a-4174-b98e-f0665eb5a6fc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.865995 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1252/2497] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:16 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:37:16.870166 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b59d1c-375e-4278-8109-c3e5a31a8a09 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.880349 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b59d1c-375e-4278-8109-c3e5a31a8a09 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.884908 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d65e0f-7e3c-4adc-85c6-2e55f80a4564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.885542 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d65e0f-7e3c-4adc-85c6-2e55f80a4564 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.885815 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d65e0f-7e3c-4adc-85c6-2e55f80a4564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.886081 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d65e0f-7e3c-4adc-85c6-2e55f80a4564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.886778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d65e0f-7e3c-4adc-85c6-2e55f80a4564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.888378 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d65e0f-7e3c-4adc-85c6-2e55f80a4564 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.898766 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1246/2498] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:37:16.903433 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3298-251a-4174-b98e-f0665eb5a6fc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.913841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3298-251a-4174-b98e-f0665eb5a6fc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:16.919138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300db1f-1e01-4913-ad67-83dcda262d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:16.919778 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300db1f-1e01-4913-ad67-83dcda262d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:16.920055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300db1f-1e01-4913-ad67-83dcda262d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:16.920321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300db1f-1e01-4913-ad67-83dcda262d1a admin admin] PATH_INFO: `/v3/projects/97b395e2bbba43a6a5e6a39d62a8f0f8/users/7ba8fbb5651f4c1c9f90cf752583ddaa/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:16.935151 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300db1f-1e01-4913-ad67-83dcda262d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b395e2bbba43a6a5e6a39d62a8f0f8, user_id=7ba8fbb5651f4c1c9f90cf752583ddaa, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:16.937799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300db1f-1e01-4913-ad67-83dcda262d1a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:16.950998 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1253/2499] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:16 2022] PUT /identity/v3/projects/97b395e2bbba43a6a5e6a39d62a8f0f8/users/7ba8fbb5651f4c1c9f90cf752583ddaa/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:16.954967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d65e0f-7e3c-4adc-85c6-2e55f80a4564 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:16.965480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d65e0f-7e3c-4adc-85c6-2e55f80a4564 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:17.022340 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b80e6-c46b-4bbc-bc92-7efeabd5c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:17.022942 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b80e6-c46b-4bbc-bc92-7efeabd5c600 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:17.023239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b80e6-c46b-4bbc-bc92-7efeabd5c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:17.023506 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b80e6-c46b-4bbc-bc92-7efeabd5c600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:17.024137 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b80e6-c46b-4bbc-bc92-7efeabd5c600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:17.025741 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b80e6-c46b-4bbc-bc92-7efeabd5c600 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:17.035789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1247/2500] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:17.039955 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300db1f-1e01-4913-ad67-83dcda262d1a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:17.050416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300db1f-1e01-4913-ad67-83dcda262d1a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:17.054904 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606da00-e84e-403d-b191-b1c8fbdf6181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:17.055535 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606da00-e84e-403d-b191-b1c8fbdf6181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:17.055814 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606da00-e84e-403d-b191-b1c8fbdf6181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:17.056266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606da00-e84e-403d-b191-b1c8fbdf6181 admin admin] PATH_INFO: `/v3/projects/97b395e2bbba43a6a5e6a39d62a8f0f8/users/7ba8fbb5651f4c1c9f90cf752583ddaa/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:17.058156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606da00-e84e-403d-b191-b1c8fbdf6181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b395e2bbba43a6a5e6a39d62a8f0f8, user_id=7ba8fbb5651f4c1c9f90cf752583ddaa, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:17.061369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606da00-e84e-403d-b191-b1c8fbdf6181 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:17.071324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1254/2501] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:17 2022] PUT /identity/v3/projects/97b395e2bbba43a6a5e6a39d62a8f0f8/users/7ba8fbb5651f4c1c9f90cf752583ddaa/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:17.083564 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd466e-1fb9-49d3-bcd6-541453a83ba4 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:17.083848 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd466e-1fb9-49d3-bcd6-541453a83ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:17.084177 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd466e-1fb9-49d3-bcd6-541453a83ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:17.111850 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-39dd466e-1fb9-49d3-bcd6-541453a83ba4 None None] MFA Rules not processed for user `7ba8fbb5651f4c1c9f90cf752583ddaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:17.113094 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-39dd466e-1fb9-49d3-bcd6-541453a83ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:17.130008 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:17.182097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1248/2502] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:17 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:17.193359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606da00-e84e-403d-b191-b1c8fbdf6181 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:17.195123 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-8606da00-e84e-403d-b191-b1c8fbdf6181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:17.274462 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606da00-e84e-403d-b191-b1c8fbdf6181 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:17.278092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21a40-3281-4fe7-a5b5-7c9424bffc2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:17.278679 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21a40-3281-4fe7-a5b5-7c9424bffc2d service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:17.278950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21a40-3281-4fe7-a5b5-7c9424bffc2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:17.279216 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21a40-3281-4fe7-a5b5-7c9424bffc2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:17.287919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21a40-3281-4fe7-a5b5-7c9424bffc2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:17.289354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21a40-3281-4fe7-a5b5-7c9424bffc2d service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:17.299094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1255/2503] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:17 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:17.436418 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd466e-1fb9-49d3-bcd6-541453a83ba4 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:17.498090 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd466e-1fb9-49d3-bcd6-541453a83ba4 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:17.502594 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:17.503206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:17.503481 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:17.503751 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] PATH_INFO: `/v3/users/6df968df017f4fffb9b96c84eb17cbe6` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:17.504855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df968df017f4fffb9b96c84eb17cbe6)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:17.506795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:17.553129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df968df017f4fffb9b96c84eb17cbe6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:17.553748 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df968df017f4fffb9b96c84eb17cbe6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:17.560802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df968df017f4fffb9b96c84eb17cbe6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:17.561461 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df968df017f4fffb9b96c84eb17cbe6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:17.573455 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df968df017f4fffb9b96c84eb17cbe6'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:17.586607 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1249/2504] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:17 2022] DELETE /identity/v3/users/6df968df017f4fffb9b96c84eb17cbe6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:17.591720 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1738fa-3772-4b7e-ad8c-6da7bec8e72b None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:17.592211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1738fa-3772-4b7e-ad8c-6da7bec8e72b None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:17.592319 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1738fa-3772-4b7e-ad8c-6da7bec8e72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:17.611220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-ce1738fa-3772-4b7e-ad8c-6da7bec8e72b None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:17.612404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ce1738fa-3772-4b7e-ad8c-6da7bec8e72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:17.659362 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:17.671427 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1256/2505] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:17.681181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:17.682581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:17.712342 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:17.744935 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ae19-4c00-4189-85d0-cdac4f87f486 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:17.749130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a83082-e221-4f00-ac01-057849e2e895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:17.749725 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83082-e221-4f00-ac01-057849e2e895 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:17.750001 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83082-e221-4f00-ac01-057849e2e895 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:17.750268 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83082-e221-4f00-ac01-057849e2e895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:17.759147 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a83082-e221-4f00-ac01-057849e2e895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:17.760611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a83082-e221-4f00-ac01-057849e2e895 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:17.771083 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1250/2506] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:18.036849 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1738fa-3772-4b7e-ad8c-6da7bec8e72b None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:18.038421 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ce1738fa-3772-4b7e-ad8c-6da7bec8e72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:18.051749 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1738fa-3772-4b7e-ad8c-6da7bec8e72b None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:18.056642 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:18.058200 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:18.059482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:18.059592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] PATH_INFO: `/v3/projects/1283c375902743f9b820eefd2058d3ae` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:18.060721 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1283c375902743f9b820eefd2058d3ae)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:18.062668 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:18.109461 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1283c375902743f9b820eefd2058d3ae', 'request_id': 'req-907e8b4d-6250-44dd-8c39-b03e737f09ba'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.116737 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1283c375902743f9b820eefd2058d3ae', 'request_id': 'req-907e8b4d-6250-44dd-8c39-b03e737f09ba'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.122799 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1283c375902743f9b820eefd2058d3ae', 'request_id': 'req-907e8b4d-6250-44dd-8c39-b03e737f09ba'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.133587 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] The token cache is being invalidate because project 1283c375902743f9b820eefd2058d3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:18.133874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.134504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.135973 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1257/2507] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:18 2022] DELETE /identity/v3/projects/1283c375902743f9b820eefd2058d3ae => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:18.140640 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a83082-e221-4f00-ac01-057849e2e895 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:18.150198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a83082-e221-4f00-ac01-057849e2e895 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:18.205974 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:18.206592 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:18.206864 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:18.207133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] PATH_INFO: `/v3/users/7ba8fbb5651f4c1c9f90cf752583ddaa` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:18.208228 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba8fbb5651f4c1c9f90cf752583ddaa)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:18.210154 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:18.258947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba8fbb5651f4c1c9f90cf752583ddaa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.259721 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba8fbb5651f4c1c9f90cf752583ddaa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.267568 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba8fbb5651f4c1c9f90cf752583ddaa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.268345 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba8fbb5651f4c1c9f90cf752583ddaa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.281609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4ca51510-7177-4101-b901-69bef91a5bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba8fbb5651f4c1c9f90cf752583ddaa'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.294067 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1251/2508] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:18 2022] DELETE /identity/v3/users/7ba8fbb5651f4c1c9f90cf752583ddaa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:18.559042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:18.560582 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:18.575536 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e8b4d-6250-44dd-8c39-b03e737f09ba admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:18.630894 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:18.631546 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:18.631774 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:18.632040 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] PATH_INFO: `/v3/projects/97b395e2bbba43a6a5e6a39d62a8f0f8` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:18.633177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b395e2bbba43a6a5e6a39d62a8f0f8)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:18.635066 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:18.681870 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b395e2bbba43a6a5e6a39d62a8f0f8', 'request_id': 'req-90ccfedf-10cf-46cd-b492-d6f87447be89'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.689905 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b395e2bbba43a6a5e6a39d62a8f0f8', 'request_id': 'req-90ccfedf-10cf-46cd-b492-d6f87447be89'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.695818 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b395e2bbba43a6a5e6a39d62a8f0f8', 'request_id': 'req-90ccfedf-10cf-46cd-b492-d6f87447be89'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.707184 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] The token cache is being invalidate because project 97b395e2bbba43a6a5e6a39d62a8f0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:18.707466 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.708092 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-90ccfedf-10cf-46cd-b492-d6f87447be89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:18.709573 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1258/2509] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:18 2022] DELETE /identity/v3/projects/97b395e2bbba43a6a5e6a39d62a8f0f8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:18.714409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c033a6b-29eb-4f3c-987d-6518153cb774 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:18.714941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c033a6b-29eb-4f3c-987d-6518153cb774 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:18.715096 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c033a6b-29eb-4f3c-987d-6518153cb774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:18.735209 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-3c033a6b-29eb-4f3c-987d-6518153cb774 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:18.736414 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-3c033a6b-29eb-4f3c-987d-6518153cb774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:18.777663 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:18.797523 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1252/2510] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:18.805152 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817630c-553e-4897-a337-de27ea499eed None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:18.805437 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817630c-553e-4897-a337-de27ea499eed None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:18.805710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817630c-553e-4897-a337-de27ea499eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:18.825681 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-5817630c-553e-4897-a337-de27ea499eed None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:18.826854 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-5817630c-553e-4897-a337-de27ea499eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:18.834691 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1259/2511] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:18.838855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c033a6b-29eb-4f3c-987d-6518153cb774 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:18.848904 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c033a6b-29eb-4f3c-987d-6518153cb774 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:18.853501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d7369-800c-4793-ae75-45d959cd946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:18.854095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7369-800c-4793-ae75-45d959cd946b admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:18.854372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7369-800c-4793-ae75-45d959cd946b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:18.854641 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7369-800c-4793-ae75-45d959cd946b admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:18.855809 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d7369-800c-4793-ae75-45d959cd946b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:37:18.856306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d7369-800c-4793-ae75-45d959cd946b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:18.857716 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d7369-800c-4793-ae75-45d959cd946b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:18.869421 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1253/2512] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:37:18.874595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817630c-553e-4897-a337-de27ea499eed None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:18.879062 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:18.885100 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817630c-553e-4897-a337-de27ea499eed None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:18.891276 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c57b8-df71-4c84-b651-ce9ecde1c262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:18.892238 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c57b8-df71-4c84-b651-ce9ecde1c262 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:18.892708 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c57b8-df71-4c84-b651-ce9ecde1c262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:18.893204 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c57b8-df71-4c84-b651-ce9ecde1c262 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:18.893995 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c57b8-df71-4c84-b651-ce9ecde1c262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:18.895919 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c57b8-df71-4c84-b651-ce9ecde1c262 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:18.923962 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1260/2513] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:18 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:18.928189 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d7369-800c-4793-ae75-45d959cd946b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:18.939555 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d7369-800c-4793-ae75-45d959cd946b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.000088 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1d53-2844-49ff-ba00-d005e4151cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.000683 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1d53-2844-49ff-ba00-d005e4151cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.000960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1d53-2844-49ff-ba00-d005e4151cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.001265 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1d53-2844-49ff-ba00-d005e4151cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.001888 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c1d53-2844-49ff-ba00-d005e4151cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.003802 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c1d53-2844-49ff-ba00-d005e4151cbc admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.024799 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1254/2514] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:18 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:19.029257 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c57b8-df71-4c84-b651-ce9ecde1c262 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.039451 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c57b8-df71-4c84-b651-ce9ecde1c262 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.044782 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bdaa2-da4f-43e7-9e3b-6483ea681fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.045464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bdaa2-da4f-43e7-9e3b-6483ea681fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.045743 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bdaa2-da4f-43e7-9e3b-6483ea681fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.046010 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bdaa2-da4f-43e7-9e3b-6483ea681fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.046642 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bdaa2-da4f-43e7-9e3b-6483ea681fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.048254 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bdaa2-da4f-43e7-9e3b-6483ea681fb6 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.058070 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1261/2515] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:19.062698 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1d53-2844-49ff-ba00-d005e4151cbc admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.073106 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1d53-2844-49ff-ba00-d005e4151cbc admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.078198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda97960-15ad-4b27-b87d-4796de719a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.078782 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda97960-15ad-4b27-b87d-4796de719a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.079056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda97960-15ad-4b27-b87d-4796de719a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.079324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda97960-15ad-4b27-b87d-4796de719a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.080030 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda97960-15ad-4b27-b87d-4796de719a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.081643 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda97960-15ad-4b27-b87d-4796de719a34 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.092533 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1255/2516] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:19.096564 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bdaa2-da4f-43e7-9e3b-6483ea681fb6 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.106839 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bdaa2-da4f-43e7-9e3b-6483ea681fb6 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.111402 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379ffd3-5f88-47e3-9232-d3cb223d5574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.112036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379ffd3-5f88-47e3-9232-d3cb223d5574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.112309 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379ffd3-5f88-47e3-9232-d3cb223d5574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.112580 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379ffd3-5f88-47e3-9232-d3cb223d5574 admin admin] PATH_INFO: `/v3/projects/2acaa432916f42f0a49fa2cdc2813d59/users/e30dd9b0eb9b4ac8820f52fbaed20bc7/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.127168 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379ffd3-5f88-47e3-9232-d3cb223d5574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2acaa432916f42f0a49fa2cdc2813d59, user_id=e30dd9b0eb9b4ac8820f52fbaed20bc7, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.129833 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379ffd3-5f88-47e3-9232-d3cb223d5574 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.142795 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1262/2517] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:19 2022] PUT /identity/v3/projects/2acaa432916f42f0a49fa2cdc2813d59/users/e30dd9b0eb9b4ac8820f52fbaed20bc7/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:19.153353 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8110f-c844-40a0-850a-b1021519c534 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.153804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8110f-c844-40a0-850a-b1021519c534 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.154239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8110f-c844-40a0-850a-b1021519c534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.182731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-91a8110f-c844-40a0-850a-b1021519c534 None None] MFA Rules not processed for user `e30dd9b0eb9b4ac8820f52fbaed20bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:19.184501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-91a8110f-c844-40a0-850a-b1021519c534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:19.247221 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1256/2518] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:37:19.251592 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379ffd3-5f88-47e3-9232-d3cb223d5574 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.312242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379ffd3-5f88-47e3-9232-d3cb223d5574 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.316884 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17427884-a3f1-4bea-b45b-2ce32bcf13e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.317504 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427884-a3f1-4bea-b45b-2ce32bcf13e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.317778 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427884-a3f1-4bea-b45b-2ce32bcf13e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.318047 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427884-a3f1-4bea-b45b-2ce32bcf13e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.318661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17427884-a3f1-4bea-b45b-2ce32bcf13e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.320530 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17427884-a3f1-4bea-b45b-2ce32bcf13e2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.347593 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1263/2519] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:19 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:19.352325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8110f-c844-40a0-850a-b1021519c534 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.363403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8110f-c844-40a0-850a-b1021519c534 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.404476 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:19.421475 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe56e01-6f65-43b7-940c-bcff69c002dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.422072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe56e01-6f65-43b7-940c-bcff69c002dd admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.422348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe56e01-6f65-43b7-940c-bcff69c002dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.422612 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe56e01-6f65-43b7-940c-bcff69c002dd admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.423239 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe56e01-6f65-43b7-940c-bcff69c002dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.425144 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe56e01-6f65-43b7-940c-bcff69c002dd admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.446354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1257/2520] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:19 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:19.451275 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17427884-a3f1-4bea-b45b-2ce32bcf13e2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.461583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17427884-a3f1-4bea-b45b-2ce32bcf13e2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.466287 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcd54e-3600-432e-906b-2ad6496ac2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.466872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcd54e-3600-432e-906b-2ad6496ac2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.467144 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcd54e-3600-432e-906b-2ad6496ac2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.467412 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcd54e-3600-432e-906b-2ad6496ac2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.468042 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcd54e-3600-432e-906b-2ad6496ac2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.469661 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcd54e-3600-432e-906b-2ad6496ac2d2 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.480773 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1264/2521] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:19.484956 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe56e01-6f65-43b7-940c-bcff69c002dd admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.494907 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe56e01-6f65-43b7-940c-bcff69c002dd admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.500454 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e921c-13bf-4b48-8fa5-74f12fde67b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.501059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e921c-13bf-4b48-8fa5-74f12fde67b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.501339 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e921c-13bf-4b48-8fa5-74f12fde67b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.501609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e921c-13bf-4b48-8fa5-74f12fde67b1 admin admin] PATH_INFO: `/v3/projects/f6df52f46ecc4f05b2f31508106eedbf/users/c72ec854b3d5408aa27eafa5c16e6858/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.516195 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e921c-13bf-4b48-8fa5-74f12fde67b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6df52f46ecc4f05b2f31508106eedbf, user_id=c72ec854b3d5408aa27eafa5c16e6858, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.518858 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e921c-13bf-4b48-8fa5-74f12fde67b1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.531341 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1258/2522] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:19 2022] PUT /identity/v3/projects/f6df52f46ecc4f05b2f31508106eedbf/users/c72ec854b3d5408aa27eafa5c16e6858/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:19.535277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcd54e-3600-432e-906b-2ad6496ac2d2 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.545915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcd54e-3600-432e-906b-2ad6496ac2d2 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.600540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9178818-42b7-4c79-977f-966b6e73d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.601171 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178818-42b7-4c79-977f-966b6e73d75d admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.601448 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178818-42b7-4c79-977f-966b6e73d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.601716 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178818-42b7-4c79-977f-966b6e73d75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.602345 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9178818-42b7-4c79-977f-966b6e73d75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.603909 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9178818-42b7-4c79-977f-966b6e73d75d admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.614150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1265/2523] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:19.618302 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e921c-13bf-4b48-8fa5-74f12fde67b1 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.629206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e921c-13bf-4b48-8fa5-74f12fde67b1 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.633822 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185d19-858c-42bc-8d1b-e9393809db1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.634459 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185d19-858c-42bc-8d1b-e9393809db1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.634733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185d19-858c-42bc-8d1b-e9393809db1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.635004 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185d19-858c-42bc-8d1b-e9393809db1b admin admin] PATH_INFO: `/v3/projects/f6df52f46ecc4f05b2f31508106eedbf/users/c72ec854b3d5408aa27eafa5c16e6858/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.636989 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34185d19-858c-42bc-8d1b-e9393809db1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6df52f46ecc4f05b2f31508106eedbf, user_id=c72ec854b3d5408aa27eafa5c16e6858, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.639581 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34185d19-858c-42bc-8d1b-e9393809db1b admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.649548 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1259/2524] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:19 2022] PUT /identity/v3/projects/f6df52f46ecc4f05b2f31508106eedbf/users/c72ec854b3d5408aa27eafa5c16e6858/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:19.713810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb31045-f85b-4f84-91f7-1998654f9570 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.714361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb31045-f85b-4f84-91f7-1998654f9570 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.714361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb31045-f85b-4f84-91f7-1998654f9570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.742514 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-adb31045-f85b-4f84-91f7-1998654f9570 None None] MFA Rules not processed for user `c72ec854b3d5408aa27eafa5c16e6858`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:19.743708 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-adb31045-f85b-4f84-91f7-1998654f9570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:19.748182 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:19.812303 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1266/2525] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:19.823348 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185d19-858c-42bc-8d1b-e9393809db1b admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.825216 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-34185d19-858c-42bc-8d1b-e9393809db1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:19.881974 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185d19-858c-42bc-8d1b-e9393809db1b admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.885546 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef7a36-a8d8-4880-81cf-eb28dd7d54af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.886135 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef7a36-a8d8-4880-81cf-eb28dd7d54af service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.886406 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef7a36-a8d8-4880-81cf-eb28dd7d54af service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.886709 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef7a36-a8d8-4880-81cf-eb28dd7d54af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:19.895571 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef7a36-a8d8-4880-81cf-eb28dd7d54af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:19.896981 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef7a36-a8d8-4880-81cf-eb28dd7d54af service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:19.907366 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1260/2526] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:19.984288 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb31045-f85b-4f84-91f7-1998654f9570 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:19.994268 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb31045-f85b-4f84-91f7-1998654f9570 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:19.998810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70b4b2-4913-4349-a2f7-0d569df0e9f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:19.999393 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70b4b2-4913-4349-a2f7-0d569df0e9f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:19.999662 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70b4b2-4913-4349-a2f7-0d569df0e9f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:19.999926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70b4b2-4913-4349-a2f7-0d569df0e9f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.056469 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70b4b2-4913-4349-a2f7-0d569df0e9f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:20.057942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70b4b2-4913-4349-a2f7-0d569df0e9f6 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:20.067441 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1267/2527] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:26.884729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef7a36-a8d8-4880-81cf-eb28dd7d54af service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:26.945927 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef7a36-a8d8-4880-81cf-eb28dd7d54af service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:26.950425 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:26.951036 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:26.951307 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:26.951572 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] PATH_INFO: `/v3/users/e30dd9b0eb9b4ac8820f52fbaed20bc7` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:26.952690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e30dd9b0eb9b4ac8820f52fbaed20bc7)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:26.954616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:26.994488 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:27.001977 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e30dd9b0eb9b4ac8820f52fbaed20bc7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.002731 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e30dd9b0eb9b4ac8820f52fbaed20bc7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.009631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e30dd9b0eb9b4ac8820f52fbaed20bc7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.010193 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e30dd9b0eb9b4ac8820f52fbaed20bc7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.022997 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e30dd9b0eb9b4ac8820f52fbaed20bc7'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.035835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1261/2528] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:26 2022] DELETE /identity/v3/users/e30dd9b0eb9b4ac8820f52fbaed20bc7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:27.040344 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0563e-70ba-4f00-b674-a6c78334451d None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:27.040860 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0563e-70ba-4f00-b674-a6c78334451d None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:27.040970 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0563e-70ba-4f00-b674-a6c78334451d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:27.060648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-0fd0563e-70ba-4f00-b674-a6c78334451d None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:27.061865 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0fd0563e-70ba-4f00-b674-a6c78334451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:27.119044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1268/2529] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:27.129358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:27.130749 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:27.187192 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa045d61-dd36-4e6b-8fb1-49180b1516e6 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:27.190858 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fe9c2-3570-4512-b5b3-ec06ec473195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:27.191458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fe9c2-3570-4512-b5b3-ec06ec473195 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:27.191733 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fe9c2-3570-4512-b5b3-ec06ec473195 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:27.192002 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fe9c2-3570-4512-b5b3-ec06ec473195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:27.201134 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fe9c2-3570-4512-b5b3-ec06ec473195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:27.202553 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fe9c2-3570-4512-b5b3-ec06ec473195 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:27.212052 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1262/2530] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:37:27.490657 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0563e-70ba-4f00-b674-a6c78334451d None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:27.492226 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-0fd0563e-70ba-4f00-b674-a6c78334451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:27.504266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0563e-70ba-4f00-b674-a6c78334451d None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:27.509176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:27.509805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:27.510079 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:27.510348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] PATH_INFO: `/v3/projects/2acaa432916f42f0a49fa2cdc2813d59` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:27.511486 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2acaa432916f42f0a49fa2cdc2813d59)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:27.513419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:27.554263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:27.565277 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2acaa432916f42f0a49fa2cdc2813d59', 'request_id': 'req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.572414 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2acaa432916f42f0a49fa2cdc2813d59', 'request_id': 'req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.578125 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2acaa432916f42f0a49fa2cdc2813d59', 'request_id': 'req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.588931 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] The token cache is being invalidate because project 2acaa432916f42f0a49fa2cdc2813d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:27.589248 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.590518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.591986 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1269/2531] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:27 2022] DELETE /identity/v3/projects/2acaa432916f42f0a49fa2cdc2813d59 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:27.595961 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fe9c2-3570-4512-b5b3-ec06ec473195 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:27.607011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fe9c2-3570-4512-b5b3-ec06ec473195 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:27.662783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:27.663403 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:27.663678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:27.663946 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] PATH_INFO: `/v3/users/c72ec854b3d5408aa27eafa5c16e6858` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:27.665111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72ec854b3d5408aa27eafa5c16e6858)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:27.667012 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:27.711978 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72ec854b3d5408aa27eafa5c16e6858'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.712610 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72ec854b3d5408aa27eafa5c16e6858'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.720702 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72ec854b3d5408aa27eafa5c16e6858'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.721582 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72ec854b3d5408aa27eafa5c16e6858'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.726219 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:27.736584 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-8318520e-6397-4982-8453-b397d0cd6ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72ec854b3d5408aa27eafa5c16e6858'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:27.748941 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1263/2532] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:27 2022] DELETE /identity/v3/users/c72ec854b3d5408aa27eafa5c16e6858 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:28.016359 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.017997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:28.034059 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f6e7-541d-435f-81d9-d9be53ae1c2e admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.091220 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.091853 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.092095 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.092358 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] PATH_INFO: `/v3/projects/f6df52f46ecc4f05b2f31508106eedbf` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.093488 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6df52f46ecc4f05b2f31508106eedbf)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.095349 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.139627 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6df52f46ecc4f05b2f31508106eedbf', 'request_id': 'req-208e5447-c29d-4f37-8068-8b63dde79ba4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:28.146745 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6df52f46ecc4f05b2f31508106eedbf', 'request_id': 'req-208e5447-c29d-4f37-8068-8b63dde79ba4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:28.152755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6df52f46ecc4f05b2f31508106eedbf', 'request_id': 'req-208e5447-c29d-4f37-8068-8b63dde79ba4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:28.163568 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] The token cache is being invalidate because project f6df52f46ecc4f05b2f31508106eedbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:28.163848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:28.164482 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-208e5447-c29d-4f37-8068-8b63dde79ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:28.165951 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1270/2533] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:28 2022] DELETE /identity/v3/projects/f6df52f46ecc4f05b2f31508106eedbf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:28.171559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fd8fc-4014-4593-87e1-c3841dc43866 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.172029 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fd8fc-4014-4593-87e1-c3841dc43866 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.172129 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fd8fc-4014-4593-87e1-c3841dc43866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.191626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-783fd8fc-4014-4593-87e1-c3841dc43866 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:28.192849 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-783fd8fc-4014-4593-87e1-c3841dc43866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:28.253975 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1264/2534] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:28.262315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ffa21-a2ec-4f53-b417-d7020c2f26b4 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.262595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ffa21-a2ec-4f53-b417-d7020c2f26b4 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.262867 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ffa21-a2ec-4f53-b417-d7020c2f26b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.282816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-105ffa21-a2ec-4f53-b417-d7020c2f26b4 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:28.284015 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-105ffa21-a2ec-4f53-b417-d7020c2f26b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:28.292176 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1271/2535] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:28.297050 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fd8fc-4014-4593-87e1-c3841dc43866 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.306871 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fd8fc-4014-4593-87e1-c3841dc43866 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.311953 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b960d-87e0-4250-93d3-a68cc610e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.312552 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b960d-87e0-4250-93d3-a68cc610e462 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.312847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b960d-87e0-4250-93d3-a68cc610e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.313150 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b960d-87e0-4250-93d3-a68cc610e462 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.313787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b960d-87e0-4250-93d3-a68cc610e462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:37:28.314086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b960d-87e0-4250-93d3-a68cc610e462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.315675 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b960d-87e0-4250-93d3-a68cc610e462 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.327306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1265/2536] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:37:28.331579 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ffa21-a2ec-4f53-b417-d7020c2f26b4 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.341852 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ffa21-a2ec-4f53-b417-d7020c2f26b4 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.346503 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86845c-06d2-4291-a24e-d73aef19b7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.347091 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86845c-06d2-4291-a24e-d73aef19b7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.347367 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86845c-06d2-4291-a24e-d73aef19b7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.347637 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86845c-06d2-4291-a24e-d73aef19b7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.348540 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86845c-06d2-4291-a24e-d73aef19b7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.350449 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86845c-06d2-4291-a24e-d73aef19b7d5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.377837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1272/2537] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:28 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:28.381923 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b960d-87e0-4250-93d3-a68cc610e462 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.393027 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b960d-87e0-4250-93d3-a68cc610e462 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.447316 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fbace-044c-4a0b-a681-808243fca3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.447906 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fbace-044c-4a0b-a681-808243fca3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.448174 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fbace-044c-4a0b-a681-808243fca3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.448437 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fbace-044c-4a0b-a681-808243fca3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.449667 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fbace-044c-4a0b-a681-808243fca3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.451537 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fbace-044c-4a0b-a681-808243fca3e2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.471446 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1266/2538] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:28 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:28.475763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86845c-06d2-4291-a24e-d73aef19b7d5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.486725 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86845c-06d2-4291-a24e-d73aef19b7d5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.491284 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0a298-798d-4600-b859-7e1cee52fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.491874 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0a298-798d-4600-b859-7e1cee52fdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.492150 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0a298-798d-4600-b859-7e1cee52fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.492417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0a298-798d-4600-b859-7e1cee52fdc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.493078 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0a298-798d-4600-b859-7e1cee52fdc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.494682 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0a298-798d-4600-b859-7e1cee52fdc4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.505356 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1273/2539] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:28.509388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fbace-044c-4a0b-a681-808243fca3e2 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.519605 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fbace-044c-4a0b-a681-808243fca3e2 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.524257 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942c9df-961d-4ab5-bcdc-3de6dd0fac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.524838 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942c9df-961d-4ab5-bcdc-3de6dd0fac7f admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.525157 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942c9df-961d-4ab5-bcdc-3de6dd0fac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.525427 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942c9df-961d-4ab5-bcdc-3de6dd0fac7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.526053 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942c9df-961d-4ab5-bcdc-3de6dd0fac7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.527833 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942c9df-961d-4ab5-bcdc-3de6dd0fac7f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.538379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1267/2540] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:28.542489 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0a298-798d-4600-b859-7e1cee52fdc4 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.553061 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0a298-798d-4600-b859-7e1cee52fdc4 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.557554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3256fa-2acc-4068-ace6-807a9c2111dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.558901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3256fa-2acc-4068-ace6-807a9c2111dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.559185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3256fa-2acc-4068-ace6-807a9c2111dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.559457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3256fa-2acc-4068-ace6-807a9c2111dc admin admin] PATH_INFO: `/v3/projects/f2bb162e3ec94cb59c194f085a08e759/users/32c03c1ce3f54bcd8d76aa9115e5a5f0/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.570336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:28.574533 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3256fa-2acc-4068-ace6-807a9c2111dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bb162e3ec94cb59c194f085a08e759, user_id=32c03c1ce3f54bcd8d76aa9115e5a5f0, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.577744 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3256fa-2acc-4068-ace6-807a9c2111dc admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.591157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1274/2541] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:28 2022] PUT /identity/v3/projects/f2bb162e3ec94cb59c194f085a08e759/users/32c03c1ce3f54bcd8d76aa9115e5a5f0/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:28.602872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82040cb-3528-4a5e-99d6-5abc84224972 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.603156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82040cb-3528-4a5e-99d6-5abc84224972 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.603426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82040cb-3528-4a5e-99d6-5abc84224972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.631436 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-c82040cb-3528-4a5e-99d6-5abc84224972 None None] MFA Rules not processed for user `32c03c1ce3f54bcd8d76aa9115e5a5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:28.632637 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-c82040cb-3528-4a5e-99d6-5abc84224972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:28.663789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:28.698040 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1268/2542] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:28.702565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3256fa-2acc-4068-ace6-807a9c2111dc admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.761963 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3256fa-2acc-4068-ace6-807a9c2111dc admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.766595 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5d63c-a715-499a-bfc1-75068c74e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.767164 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5d63c-a715-499a-bfc1-75068c74e901 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.767438 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5d63c-a715-499a-bfc1-75068c74e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.767705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5d63c-a715-499a-bfc1-75068c74e901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.768314 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5d63c-a715-499a-bfc1-75068c74e901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.770208 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5d63c-a715-499a-bfc1-75068c74e901 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.796694 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1275/2543] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:28 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:28.800767 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82040cb-3528-4a5e-99d6-5abc84224972 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.811770 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82040cb-3528-4a5e-99d6-5abc84224972 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.867059 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c9333-44c3-4342-a659-196be1ea7338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.867656 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c9333-44c3-4342-a659-196be1ea7338 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.867931 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c9333-44c3-4342-a659-196be1ea7338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.868200 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c9333-44c3-4342-a659-196be1ea7338 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.868831 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c9333-44c3-4342-a659-196be1ea7338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.870967 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c9333-44c3-4342-a659-196be1ea7338 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.891686 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1269/2544] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:28 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:37:28.895638 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5d63c-a715-499a-bfc1-75068c74e901 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.906442 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5d63c-a715-499a-bfc1-75068c74e901 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.911194 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b438a1-dcf7-4324-af30-6dcee2809645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.911796 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b438a1-dcf7-4324-af30-6dcee2809645 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.912124 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b438a1-dcf7-4324-af30-6dcee2809645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.912336 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b438a1-dcf7-4324-af30-6dcee2809645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.912969 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b438a1-dcf7-4324-af30-6dcee2809645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.914584 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b438a1-dcf7-4324-af30-6dcee2809645 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.925979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1276/2545] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:28.930158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c9333-44c3-4342-a659-196be1ea7338 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.940136 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c9333-44c3-4342-a659-196be1ea7338 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:28.944636 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93520ed-acc8-4b49-9f54-738a685f524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:28.945335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93520ed-acc8-4b49-9f54-738a685f524f admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:28.945609 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93520ed-acc8-4b49-9f54-738a685f524f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:28.945875 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93520ed-acc8-4b49-9f54-738a685f524f admin admin] PATH_INFO: `/v3/projects/c6e9ca4654444feba3be3efa57287776/users/fb06d0a685c741a6adcfacb48d8ae5a1/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:28.960086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93520ed-acc8-4b49-9f54-738a685f524f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e9ca4654444feba3be3efa57287776, user_id=fb06d0a685c741a6adcfacb48d8ae5a1, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:28.962735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93520ed-acc8-4b49-9f54-738a685f524f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:28.976333 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1270/2546] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:28 2022] PUT /identity/v3/projects/c6e9ca4654444feba3be3efa57287776/users/fb06d0a685c741a6adcfacb48d8ae5a1/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:37:28.980245 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b438a1-dcf7-4324-af30-6dcee2809645 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:28.990629 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b438a1-dcf7-4324-af30-6dcee2809645 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:29.045557 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005b5f-8bd1-4c0d-b8f2-015c56a538bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:29.046157 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005b5f-8bd1-4c0d-b8f2-015c56a538bf admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:29.046436 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005b5f-8bd1-4c0d-b8f2-015c56a538bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:29.046757 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005b5f-8bd1-4c0d-b8f2-015c56a538bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:29.047337 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005b5f-8bd1-4c0d-b8f2-015c56a538bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:29.048914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005b5f-8bd1-4c0d-b8f2-015c56a538bf admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:29.058549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1277/2547] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:29.062685 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93520ed-acc8-4b49-9f54-738a685f524f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:29.072963 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93520ed-acc8-4b49-9f54-738a685f524f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:29.077577 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2c92-a6bb-45f7-b0ce-49626a50ae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:29.078208 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2c92-a6bb-45f7-b0ce-49626a50ae41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:29.078480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2c92-a6bb-45f7-b0ce-49626a50ae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:29.078746 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2c92-a6bb-45f7-b0ce-49626a50ae41 admin admin] PATH_INFO: `/v3/projects/c6e9ca4654444feba3be3efa57287776/users/fb06d0a685c741a6adcfacb48d8ae5a1/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:29.080678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2c92-a6bb-45f7-b0ce-49626a50ae41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e9ca4654444feba3be3efa57287776, user_id=fb06d0a685c741a6adcfacb48d8ae5a1, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:29.083309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2c92-a6bb-45f7-b0ce-49626a50ae41 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:29.093868 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1271/2548] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:29 2022] PUT /identity/v3/projects/c6e9ca4654444feba3be3efa57287776/users/fb06d0a685c741a6adcfacb48d8ae5a1/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:29.104033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af47cea-42ef-47cb-b286-cae4006c2c86 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:29.104507 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af47cea-42ef-47cb-b286-cae4006c2c86 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:29.104612 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af47cea-42ef-47cb-b286-cae4006c2c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:29.132317 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9af47cea-42ef-47cb-b286-cae4006c2c86 None None] MFA Rules not processed for user `fb06d0a685c741a6adcfacb48d8ae5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:29.133543 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9af47cea-42ef-47cb-b286-cae4006c2c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:29.179837 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:29.202956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1278/2549] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:29.213724 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2c92-a6bb-45f7-b0ce-49626a50ae41 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:29.216603 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b87e2c92-a6bb-45f7-b0ce-49626a50ae41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:29.273082 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2c92-a6bb-45f7-b0ce-49626a50ae41 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:29.276693 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9f722-6284-4b3d-8255-4c2871c6b70b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:29.277335 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9f722-6284-4b3d-8255-4c2871c6b70b service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:29.277620 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9f722-6284-4b3d-8255-4c2871c6b70b service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:29.277872 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9f722-6284-4b3d-8255-4c2871c6b70b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:29.286688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9f722-6284-4b3d-8255-4c2871c6b70b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:29.288091 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9f722-6284-4b3d-8255-4c2871c6b70b service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:29.298061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1272/2550] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:29.828947 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af47cea-42ef-47cb-b286-cae4006c2c86 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:29.889780 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af47cea-42ef-47cb-b286-cae4006c2c86 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:29.894244 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:29.894859 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:29.895131 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:29.895398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] PATH_INFO: `/v3/users/32c03c1ce3f54bcd8d76aa9115e5a5f0` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:29.896500 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c03c1ce3f54bcd8d76aa9115e5a5f0)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:29.898428 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:29.947054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c03c1ce3f54bcd8d76aa9115e5a5f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:29.954422 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c03c1ce3f54bcd8d76aa9115e5a5f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:29.955041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c03c1ce3f54bcd8d76aa9115e5a5f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:29.966649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c03c1ce3f54bcd8d76aa9115e5a5f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:29.973594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c03c1ce3f54bcd8d76aa9115e5a5f0'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:29.979407 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1279/2551] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:29 2022] DELETE /identity/v3/users/32c03c1ce3f54bcd8d76aa9115e5a5f0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:29.984511 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ee65-332d-4b04-90c9-34caf20d57fb None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:29.984795 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ee65-332d-4b04-90c9-34caf20d57fb None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:29.985100 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ee65-332d-4b04-90c9-34caf20d57fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:30.004452 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-a584ee65-332d-4b04-90c9-34caf20d57fb None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:30.005680 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a584ee65-332d-4b04-90c9-34caf20d57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:30.028628 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:30.065687 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1273/2552] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:30.075235 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:30.076643 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:30.132979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512e98e-dc41-448c-affa-a2088a751041 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:30.136583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed99ff-bef1-4de0-9f78-0cbf68f79c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:30.137202 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed99ff-bef1-4de0-9f78-0cbf68f79c53 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:30.137471 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed99ff-bef1-4de0-9f78-0cbf68f79c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:30.137733 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed99ff-bef1-4de0-9f78-0cbf68f79c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:30.146419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed99ff-bef1-4de0-9f78-0cbf68f79c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:30.147827 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed99ff-bef1-4de0-9f78-0cbf68f79c53 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:30.157166 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1280/2553] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:30.425480 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584ee65-332d-4b04-90c9-34caf20d57fb None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:30.427060 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-a584ee65-332d-4b04-90c9-34caf20d57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:30.439324 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584ee65-332d-4b04-90c9-34caf20d57fb None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:30.444389 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:30.445206 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:30.445485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:30.445755 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] PATH_INFO: `/v3/projects/f2bb162e3ec94cb59c194f085a08e759` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:30.447234 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2bb162e3ec94cb59c194f085a08e759)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:30.449354 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:30.496947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2bb162e3ec94cb59c194f085a08e759', 'request_id': 'req-2dcac675-8069-4ab7-924a-39d8ed8f653e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:30.502388 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2bb162e3ec94cb59c194f085a08e759', 'request_id': 'req-2dcac675-8069-4ab7-924a-39d8ed8f653e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:30.508458 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2bb162e3ec94cb59c194f085a08e759', 'request_id': 'req-2dcac675-8069-4ab7-924a-39d8ed8f653e'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:30.520719 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] The token cache is being invalidate because project f2bb162e3ec94cb59c194f085a08e759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:30.521024 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:30.521658 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:30.523107 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1274/2554] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:30 2022] DELETE /identity/v3/projects/f2bb162e3ec94cb59c194f085a08e759 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:30.527547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed99ff-bef1-4de0-9f78-0cbf68f79c53 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:30.537033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed99ff-bef1-4de0-9f78-0cbf68f79c53 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:30.540552 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:30.595104 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:30.595800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:30.596008 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:30.596278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] PATH_INFO: `/v3/users/fb06d0a685c741a6adcfacb48d8ae5a1` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:30.597478 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb06d0a685c741a6adcfacb48d8ae5a1)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:30.599706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:30.643730 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb06d0a685c741a6adcfacb48d8ae5a1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:30.650718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb06d0a685c741a6adcfacb48d8ae5a1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:30.651321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb06d0a685c741a6adcfacb48d8ae5a1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:30.662984 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb06d0a685c741a6adcfacb48d8ae5a1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:30.670132 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-357d8e8e-fa84-4c23-a726-ecebec82fd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb06d0a685c741a6adcfacb48d8ae5a1'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:30.676075 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1281/2555] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:30 2022] DELETE /identity/v3/users/fb06d0a685c741a6adcfacb48d8ae5a1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:30.941510 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:30.943075 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:30.956588 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcac675-8069-4ab7-924a-39d8ed8f653e admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.015197 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.015821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.016095 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.016362 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] PATH_INFO: `/v3/projects/c6e9ca4654444feba3be3efa57287776` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.017485 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e9ca4654444feba3be3efa57287776)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.019358 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.064326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e9ca4654444feba3be3efa57287776', 'request_id': 'req-0f359c6f-0a03-4931-9488-81244a9452e2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:31.068111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:31.070501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e9ca4654444feba3be3efa57287776', 'request_id': 'req-0f359c6f-0a03-4931-9488-81244a9452e2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:31.078655 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e9ca4654444feba3be3efa57287776', 'request_id': 'req-0f359c6f-0a03-4931-9488-81244a9452e2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:31.091619 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] The token cache is being invalidate because project c6e9ca4654444feba3be3efa57287776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:31.091905 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:31.092518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-0f359c6f-0a03-4931-9488-81244a9452e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:31.093991 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1275/2556] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:30 2022] DELETE /identity/v3/projects/c6e9ca4654444feba3be3efa57287776 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:31.099066 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76410-a9f6-4ced-84b4-30646e799849 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.099348 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76410-a9f6-4ced-84b4-30646e799849 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.099619 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76410-a9f6-4ced-84b4-30646e799849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.119638 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-4aa76410-a9f6-4ced-84b4-30646e799849 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:31.120992 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-4aa76410-a9f6-4ced-84b4-30646e799849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:31.180094 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1282/2557] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:31.188502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43648-ad9e-4342-b991-69caab1070a7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.188790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43648-ad9e-4342-b991-69caab1070a7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.189097 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43648-ad9e-4342-b991-69caab1070a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.209278 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-2ee43648-ad9e-4342-b991-69caab1070a7 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:31.210479 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-2ee43648-ad9e-4342-b991-69caab1070a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:31.218266 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1276/2558] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:37:31.222610 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76410-a9f6-4ced-84b4-30646e799849 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.232569 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76410-a9f6-4ced-84b4-30646e799849 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.237077 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b2ab-1631-4ced-bc7b-804ac4d29b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.237664 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b2ab-1631-4ced-bc7b-804ac4d29b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.237938 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b2ab-1631-4ced-bc7b-804ac4d29b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.238207 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b2ab-1631-4ced-bc7b-804ac4d29b92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.238872 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b2ab-1631-4ced-bc7b-804ac4d29b92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81558) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:37:31.239194 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b2ab-1631-4ced-bc7b-804ac4d29b92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.240769 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b2ab-1631-4ced-bc7b-804ac4d29b92 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.252589 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1283/2559] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:37:31.256756 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee43648-ad9e-4342-b991-69caab1070a7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.266590 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee43648-ad9e-4342-b991-69caab1070a7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.271204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28f1f9-acbd-4b70-993f-dfc7bf06b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.271773 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28f1f9-acbd-4b70-993f-dfc7bf06b1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.272044 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28f1f9-acbd-4b70-993f-dfc7bf06b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.272308 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28f1f9-acbd-4b70-993f-dfc7bf06b1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.272936 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28f1f9-acbd-4b70-993f-dfc7bf06b1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.274886 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28f1f9-acbd-4b70-993f-dfc7bf06b1b4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.302657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1277/2560] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:31 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:31.305221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b2ab-1631-4ced-bc7b-804ac4d29b92 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.315772 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b2ab-1631-4ced-bc7b-804ac4d29b92 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.325343 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:31.374983 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a6205-7e82-430e-81ff-b78ecdd73cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.375506 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a6205-7e82-430e-81ff-b78ecdd73cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.375784 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a6205-7e82-430e-81ff-b78ecdd73cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.376052 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a6205-7e82-430e-81ff-b78ecdd73cdf admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.376709 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a6205-7e82-430e-81ff-b78ecdd73cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.378649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a6205-7e82-430e-81ff-b78ecdd73cdf admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.399330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1284/2561] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:31 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:31.404236 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28f1f9-acbd-4b70-993f-dfc7bf06b1b4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.414279 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28f1f9-acbd-4b70-993f-dfc7bf06b1b4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.418921 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cafb6-eedc-4933-89f6-136a89800fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.419504 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cafb6-eedc-4933-89f6-136a89800fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.419794 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cafb6-eedc-4933-89f6-136a89800fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.420037 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cafb6-eedc-4933-89f6-136a89800fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.420657 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cafb6-eedc-4933-89f6-136a89800fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.422271 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cafb6-eedc-4933-89f6-136a89800fe5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.431880 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1278/2562] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:31.436355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a6205-7e82-430e-81ff-b78ecdd73cdf admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.446185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a6205-7e82-430e-81ff-b78ecdd73cdf admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.451457 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3dd0b-598c-4283-b0c0-604b222b0b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.452043 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3dd0b-598c-4283-b0c0-604b222b0b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.452324 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3dd0b-598c-4283-b0c0-604b222b0b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.452594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3dd0b-598c-4283-b0c0-604b222b0b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.453266 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3dd0b-598c-4283-b0c0-604b222b0b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.454835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3dd0b-598c-4283-b0c0-604b222b0b85 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.465527 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1285/2563] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:31.469574 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cafb6-eedc-4933-89f6-136a89800fe5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.479788 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cafb6-eedc-4933-89f6-136a89800fe5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.485127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316885d-a89e-4def-a702-e01fe581d6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.485778 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316885d-a89e-4def-a702-e01fe581d6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.486055 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316885d-a89e-4def-a702-e01fe581d6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.486326 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316885d-a89e-4def-a702-e01fe581d6c4 admin admin] PATH_INFO: `/v3/projects/20da700ba43341988b1418e83953cbf7/users/2df8927ea0764b36ac731ac5ead4663c/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.501395 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316885d-a89e-4def-a702-e01fe581d6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20da700ba43341988b1418e83953cbf7, user_id=2df8927ea0764b36ac731ac5ead4663c, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.504247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316885d-a89e-4def-a702-e01fe581d6c4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.516835 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1279/2564] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:31 2022] PUT /identity/v3/projects/20da700ba43341988b1418e83953cbf7/users/2df8927ea0764b36ac731ac5ead4663c/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:37:31.528283 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181a3e-52a2-4ee0-9ba4-2c4345d1a920 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.528566 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181a3e-52a2-4ee0-9ba4-2c4345d1a920 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.528841 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4181a3e-52a2-4ee0-9ba4-2c4345d1a920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.557659 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-b4181a3e-52a2-4ee0-9ba4-2c4345d1a920 None None] MFA Rules not processed for user `2df8927ea0764b36ac731ac5ead4663c`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:31.559458 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-b4181a3e-52a2-4ee0-9ba4-2c4345d1a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:31.622195 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1286/2565] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:31.626912 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316885d-a89e-4def-a702-e01fe581d6c4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.687198 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316885d-a89e-4def-a702-e01fe581d6c4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.692579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6b0e-f0bd-46fc-a315-cccbddf2b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.693202 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6b0e-f0bd-46fc-a315-cccbddf2b511 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.693477 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6b0e-f0bd-46fc-a315-cccbddf2b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.693752 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d6b0e-f0bd-46fc-a315-cccbddf2b511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.694381 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d6b0e-f0bd-46fc-a315-cccbddf2b511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.696247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d6b0e-f0bd-46fc-a315-cccbddf2b511 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.723674 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1280/2566] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:31 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:31.727748 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4181a3e-52a2-4ee0-9ba4-2c4345d1a920 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.738715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4181a3e-52a2-4ee0-9ba4-2c4345d1a920 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.796726 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41859e9-fa60-43d1-b9dc-c44aef1ed7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.797354 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41859e9-fa60-43d1-b9dc-c44aef1ed7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.797628 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41859e9-fa60-43d1-b9dc-c44aef1ed7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.797890 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41859e9-fa60-43d1-b9dc-c44aef1ed7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.798518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41859e9-fa60-43d1-b9dc-c44aef1ed7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.800429 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41859e9-fa60-43d1-b9dc-c44aef1ed7a5 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.820690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1287/2567] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:31 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:37:31.825175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6b0e-f0bd-46fc-a315-cccbddf2b511 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.835273 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d6b0e-f0bd-46fc-a315-cccbddf2b511 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.840790 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460a614-f9eb-4c87-8fc0-d98f4b9639e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.841434 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460a614-f9eb-4c87-8fc0-d98f4b9639e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.841708 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460a614-f9eb-4c87-8fc0-d98f4b9639e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.841973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460a614-f9eb-4c87-8fc0-d98f4b9639e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.842599 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460a614-f9eb-4c87-8fc0-d98f4b9639e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.844163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460a614-f9eb-4c87-8fc0-d98f4b9639e5 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.854808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1281/2568] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:31.858923 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41859e9-fa60-43d1-b9dc-c44aef1ed7a5 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.868715 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41859e9-fa60-43d1-b9dc-c44aef1ed7a5 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.873979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908d10b-1770-4b8d-861c-7c5fcf2df5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.874613 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908d10b-1770-4b8d-861c-7c5fcf2df5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.874887 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908d10b-1770-4b8d-861c-7c5fcf2df5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.875155 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908d10b-1770-4b8d-861c-7c5fcf2df5ba admin admin] PATH_INFO: `/v3/projects/90029145b39244998e9623de1cdbc9a6/users/46ffc3e9bd324ee597f9c35dab510839/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.883479 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:31.891404 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908d10b-1770-4b8d-861c-7c5fcf2df5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=90029145b39244998e9623de1cdbc9a6, user_id=46ffc3e9bd324ee597f9c35dab510839, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.894260 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908d10b-1770-4b8d-861c-7c5fcf2df5ba admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.907006 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1288/2569] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:31 2022] PUT /identity/v3/projects/90029145b39244998e9623de1cdbc9a6/users/46ffc3e9bd324ee597f9c35dab510839/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:31.911084 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460a614-f9eb-4c87-8fc0-d98f4b9639e5 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:31.921914 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460a614-f9eb-4c87-8fc0-d98f4b9639e5 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:31.967900 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:31.978203 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff2e21-c9e3-4372-9040-40fe85cf45f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:31.979011 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff2e21-c9e3-4372-9040-40fe85cf45f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:31.979297 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff2e21-c9e3-4372-9040-40fe85cf45f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:31.979717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff2e21-c9e3-4372-9040-40fe85cf45f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:31.981142 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff2e21-c9e3-4372-9040-40fe85cf45f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:31.982747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff2e21-c9e3-4372-9040-40fe85cf45f4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:31.992446 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1282/2570] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:31.996810 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908d10b-1770-4b8d-861c-7c5fcf2df5ba admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:32.007156 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908d10b-1770-4b8d-861c-7c5fcf2df5ba admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:32.011989 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be91ca-aee6-420c-9237-aaa5ed74e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:32.012631 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be91ca-aee6-420c-9237-aaa5ed74e899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:32.012913 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be91ca-aee6-420c-9237-aaa5ed74e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:32.013217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be91ca-aee6-420c-9237-aaa5ed74e899 admin admin] PATH_INFO: `/v3/projects/90029145b39244998e9623de1cdbc9a6/users/46ffc3e9bd324ee597f9c35dab510839/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:32.015108 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be91ca-aee6-420c-9237-aaa5ed74e899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90029145b39244998e9623de1cdbc9a6, user_id=46ffc3e9bd324ee597f9c35dab510839, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:32.017825 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be91ca-aee6-420c-9237-aaa5ed74e899 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:32.028483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1289/2571] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:31 2022] PUT /identity/v3/projects/90029145b39244998e9623de1cdbc9a6/users/46ffc3e9bd324ee597f9c35dab510839/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:32.038502 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6b796-9f79-408d-9f20-4a0aa6f162d3 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:32.038783 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6b796-9f79-408d-9f20-4a0aa6f162d3 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:32.039056 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6b796-9f79-408d-9f20-4a0aa6f162d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:32.067155 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-55b6b796-9f79-408d-9f20-4a0aa6f162d3 None None] MFA Rules not processed for user `46ffc3e9bd324ee597f9c35dab510839`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:32.068372 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-55b6b796-9f79-408d-9f20-4a0aa6f162d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:32.135592 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1283/2572] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:37:32.146518 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be91ca-aee6-420c-9237-aaa5ed74e899 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:32.148209 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-97be91ca-aee6-420c-9237-aaa5ed74e899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:32.205803 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be91ca-aee6-420c-9237-aaa5ed74e899 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:32.209465 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcd002-d3f2-4dab-a087-166aa1d6b807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:32.210056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcd002-d3f2-4dab-a087-166aa1d6b807 service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:32.210322 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcd002-d3f2-4dab-a087-166aa1d6b807 service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:32.210583 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcd002-d3f2-4dab-a087-166aa1d6b807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:32.269080 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcd002-d3f2-4dab-a087-166aa1d6b807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:32.270505 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcd002-d3f2-4dab-a087-166aa1d6b807 service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:32.280278 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1290/2573] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:34.813768 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6b796-9f79-408d-9f20-4a0aa6f162d3 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:34.875633 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6b796-9f79-408d-9f20-4a0aa6f162d3 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:34.880111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:34.880729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:34.881020 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:34.881304 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] PATH_INFO: `/v3/users/2df8927ea0764b36ac731ac5ead4663c` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:34.882397 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df8927ea0764b36ac731ac5ead4663c)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:34.884309 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:34.929857 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df8927ea0764b36ac731ac5ead4663c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:34.930501 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df8927ea0764b36ac731ac5ead4663c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:34.937855 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df8927ea0764b36ac731ac5ead4663c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:34.938514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df8927ea0764b36ac731ac5ead4663c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:34.950811 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df8927ea0764b36ac731ac5ead4663c'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:34.953246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:34.964737 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1284/2574] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:34 2022] DELETE /identity/v3/users/2df8927ea0764b36ac731ac5ead4663c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:34.969567 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1352ee-b849-4354-8fb7-be165e47f460 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:34.970064 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1352ee-b849-4354-8fb7-be165e47f460 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:34.970177 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1352ee-b849-4354-8fb7-be165e47f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:34.989330 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9e1352ee-b849-4354-8fb7-be165e47f460 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:34.990526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9e1352ee-b849-4354-8fb7-be165e47f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:35.048747 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1291/2575] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:35.058926 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:35.060345 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:35.117483 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9ce6c-cb21-4780-9d95-d056a8dd50b4 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:35.121772 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d03e9-e3d7-4a44-8688-c0a8c8269170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:35.122361 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d03e9-e3d7-4a44-8688-c0a8c8269170 service neutron] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:35.122631 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d03e9-e3d7-4a44-8688-c0a8c8269170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:35.122898 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d03e9-e3d7-4a44-8688-c0a8c8269170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:35.131742 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d03e9-e3d7-4a44-8688-c0a8c8269170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:35.133175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d03e9-e3d7-4a44-8688-c0a8c8269170 service neutron] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:35.143111 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1285/2576] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:35.409523 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1352ee-b849-4354-8fb7-be165e47f460 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:35.411379 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9e1352ee-b849-4354-8fb7-be165e47f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:35.424848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1352ee-b849-4354-8fb7-be165e47f460 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:35.429526 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:35.430217 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:35.430555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:35.430908 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] PATH_INFO: `/v3/projects/20da700ba43341988b1418e83953cbf7` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:35.432030 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20da700ba43341988b1418e83953cbf7)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:35.434718 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:35.459487 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:35.483480 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20da700ba43341988b1418e83953cbf7', 'request_id': 'req-ce8d264a-3914-44f5-a80e-73fb9671b470'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:35.490719 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20da700ba43341988b1418e83953cbf7', 'request_id': 'req-ce8d264a-3914-44f5-a80e-73fb9671b470'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:35.497660 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20da700ba43341988b1418e83953cbf7', 'request_id': 'req-ce8d264a-3914-44f5-a80e-73fb9671b470'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:35.508524 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] The token cache is being invalidate because project 20da700ba43341988b1418e83953cbf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:35.508815 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:35.509888 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:35.511869 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1292/2577] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:35 2022] DELETE /identity/v3/projects/20da700ba43341988b1418e83953cbf7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:35.515994 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d03e9-e3d7-4a44-8688-c0a8c8269170 service neutron] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:35.525528 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d03e9-e3d7-4a44-8688-c0a8c8269170 service neutron] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:35.582275 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:35.582960 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:35.583175 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:35.583448 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] PATH_INFO: `/v3/users/46ffc3e9bd324ee597f9c35dab510839` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:35.584579 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ffc3e9bd324ee597f9c35dab510839)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:35.586514 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:35.633703 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ffc3e9bd324ee597f9c35dab510839'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:35.634349 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ffc3e9bd324ee597f9c35dab510839'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:35.641797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ffc3e9bd324ee597f9c35dab510839'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:35.642433 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ffc3e9bd324ee597f9c35dab510839'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:35.655572 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-226b309c-ff09-4673-8a6f-9688b2a26972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ffc3e9bd324ee597f9c35dab510839'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:35.668688 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1286/2578] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:35 2022] DELETE /identity/v3/users/46ffc3e9bd324ee597f9c35dab510839 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:35.943416 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:35.944980 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:35.960652 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d264a-3914-44f5-a80e-73fb9671b470 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.020141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.020783 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.021039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.021315 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] PATH_INFO: `/v3/projects/90029145b39244998e9623de1cdbc9a6` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.022409 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90029145b39244998e9623de1cdbc9a6)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.024290 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.068897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90029145b39244998e9623de1cdbc9a6', 'request_id': 'req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:36.076727 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90029145b39244998e9623de1cdbc9a6', 'request_id': 'req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:36.082236 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90029145b39244998e9623de1cdbc9a6', 'request_id': 'req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:36.094221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] The token cache is being invalidate because project 90029145b39244998e9623de1cdbc9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81558) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:36.094712 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:36.095706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-b18b68ce-9c21-4b3c-96ce-ba2119bf46b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:36.100755 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1293/2579] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:35 2022] DELETE /identity/v3/projects/90029145b39244998e9623de1cdbc9a6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:36.102608 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b46a8-560f-40e1-81a4-081ef081300f None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.103086 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b46a8-560f-40e1-81a4-081ef081300f None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.103204 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b46a8-560f-40e1-81a4-081ef081300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.122809 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-710b46a8-560f-40e1-81a4-081ef081300f None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:36.123948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-710b46a8-560f-40e1-81a4-081ef081300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:36.133986 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:36.185547 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1287/2580] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:37:36.193269 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790b82-107e-4750-b465-e075574236f3 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.193549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790b82-107e-4750-b465-e075574236f3 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.193816 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790b82-107e-4750-b465-e075574236f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.214375 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-fc790b82-107e-4750-b465-e075574236f3 None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:36.215572 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-fc790b82-107e-4750-b465-e075574236f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:36.224231 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1294/2581] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:36.228363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b46a8-560f-40e1-81a4-081ef081300f None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.237922 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b46a8-560f-40e1-81a4-081ef081300f None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.242379 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3fabf-994d-4e88-8370-d1e261ec7916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.242957 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3fabf-994d-4e88-8370-d1e261ec7916 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.243232 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3fabf-994d-4e88-8370-d1e261ec7916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.243500 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3fabf-994d-4e88-8370-d1e261ec7916 admin admin] PATH_INFO: `/v3/domains` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.244133 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3fabf-994d-4e88-8370-d1e261ec7916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81559) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:37:36.244430 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3fabf-994d-4e88-8370-d1e261ec7916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.246146 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3fabf-994d-4e88-8370-d1e261ec7916 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.257573 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1288/2582] 10.222.0.13 () {58 vars in 1153 bytes} [Wed Nov 2 07:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:37:36.262252 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc790b82-107e-4750-b465-e075574236f3 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.271483 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc790b82-107e-4750-b465-e075574236f3 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.276185 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4930d-d690-4f0a-811e-b7bfc68c0572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.277759 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4930d-d690-4f0a-811e-b7bfc68c0572 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.277956 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4930d-d690-4f0a-811e-b7bfc68c0572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.278134 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4930d-d690-4f0a-811e-b7bfc68c0572 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.278764 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4930d-d690-4f0a-811e-b7bfc68c0572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.280633 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4930d-d690-4f0a-811e-b7bfc68c0572 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.306753 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1295/2583] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:36 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:36.310883 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3fabf-994d-4e88-8370-d1e261ec7916 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.320847 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3fabf-994d-4e88-8370-d1e261ec7916 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.377538 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04be512-878e-48f3-909e-6cfd835ca928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.378061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be512-878e-48f3-909e-6cfd835ca928 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.378337 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be512-878e-48f3-909e-6cfd835ca928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.378608 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be512-878e-48f3-909e-6cfd835ca928 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.379231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04be512-878e-48f3-909e-6cfd835ca928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.381156 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04be512-878e-48f3-909e-6cfd835ca928 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.402728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1289/2584] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:36 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:36.406820 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4930d-d690-4f0a-811e-b7bfc68c0572 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.416950 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4930d-d690-4f0a-811e-b7bfc68c0572 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.421603 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1806b36-89b8-4b54-acea-c7ed340f11f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.422179 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1806b36-89b8-4b54-acea-c7ed340f11f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.422455 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1806b36-89b8-4b54-acea-c7ed340f11f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.422724 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1806b36-89b8-4b54-acea-c7ed340f11f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.423361 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1806b36-89b8-4b54-acea-c7ed340f11f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.424932 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1806b36-89b8-4b54-acea-c7ed340f11f9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.435321 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1296/2585] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:36.439139 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04be512-878e-48f3-909e-6cfd835ca928 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.449681 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04be512-878e-48f3-909e-6cfd835ca928 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.454211 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6564612-6556-453f-844e-adec4bc079fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.454787 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564612-6556-453f-844e-adec4bc079fb admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.455061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564612-6556-453f-844e-adec4bc079fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.455329 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564612-6556-453f-844e-adec4bc079fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.455947 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6564612-6556-453f-844e-adec4bc079fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.457565 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6564612-6556-453f-844e-adec4bc079fb admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.468158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1290/2586] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:36.472032 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1806b36-89b8-4b54-acea-c7ed340f11f9 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.477398 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:36.483910 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1806b36-89b8-4b54-acea-c7ed340f11f9 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.489700 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472a9af-1c0a-4bf8-b730-3bad3054af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.490335 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a9af-1c0a-4bf8-b730-3bad3054af7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.490605 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a9af-1c0a-4bf8-b730-3bad3054af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.490871 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a9af-1c0a-4bf8-b730-3bad3054af7a admin admin] PATH_INFO: `/v3/projects/d9bb3f77c9414098a3b210edc433db32/users/5f8171d9af4f47b69ce5f94090b6201a/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.505677 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472a9af-1c0a-4bf8-b730-3bad3054af7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bb3f77c9414098a3b210edc433db32, user_id=5f8171d9af4f47b69ce5f94090b6201a, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.508293 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472a9af-1c0a-4bf8-b730-3bad3054af7a admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.521805 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1297/2587] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:36 2022] PUT /identity/v3/projects/d9bb3f77c9414098a3b210edc433db32/users/5f8171d9af4f47b69ce5f94090b6201a/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:36.533158 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af11f-4614-4838-a362-c77a107bb72d None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.533469 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af11f-4614-4838-a362-c77a107bb72d None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.533747 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025af11f-4614-4838-a362-c77a107bb72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.561504 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-025af11f-4614-4838-a362-c77a107bb72d None None] MFA Rules not processed for user `5f8171d9af4f47b69ce5f94090b6201a`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:36.562707 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-025af11f-4614-4838-a362-c77a107bb72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:36.626717 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1291/2588] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:36.631212 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472a9af-1c0a-4bf8-b730-3bad3054af7a admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.692305 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472a9af-1c0a-4bf8-b730-3bad3054af7a admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.696895 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abc507-98b2-4a0a-8d55-c8d7ceb12f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.697515 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc507-98b2-4a0a-8d55-c8d7ceb12f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.697788 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc507-98b2-4a0a-8d55-c8d7ceb12f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.698056 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc507-98b2-4a0a-8d55-c8d7ceb12f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.699263 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abc507-98b2-4a0a-8d55-c8d7ceb12f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.701301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abc507-98b2-4a0a-8d55-c8d7ceb12f90 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.727044 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1298/2589] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:36 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:36.731734 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af11f-4614-4838-a362-c77a107bb72d None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.742419 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025af11f-4614-4838-a362-c77a107bb72d None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.750409 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:36.799028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c581871-b507-4f34-ae7d-64f93517f6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.799623 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c581871-b507-4f34-ae7d-64f93517f6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.799901 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c581871-b507-4f34-ae7d-64f93517f6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.800173 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c581871-b507-4f34-ae7d-64f93517f6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.800804 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c581871-b507-4f34-ae7d-64f93517f6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.802735 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c581871-b507-4f34-ae7d-64f93517f6a3 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.823937 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1292/2590] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:36 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:37:36.827942 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abc507-98b2-4a0a-8d55-c8d7ceb12f90 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.838039 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abc507-98b2-4a0a-8d55-c8d7ceb12f90 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.842835 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79058327-b8c6-4764-a476-3d98b39a32ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.843424 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79058327-b8c6-4764-a476-3d98b39a32ff admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.843697 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79058327-b8c6-4764-a476-3d98b39a32ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.843966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79058327-b8c6-4764-a476-3d98b39a32ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.844594 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79058327-b8c6-4764-a476-3d98b39a32ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.846221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79058327-b8c6-4764-a476-3d98b39a32ff admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.858541 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1299/2591] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:36.862334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c581871-b507-4f34-ae7d-64f93517f6a3 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.873032 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c581871-b507-4f34-ae7d-64f93517f6a3 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.877678 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1343c-42bc-4d95-906d-6d7d59a60653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.878321 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1343c-42bc-4d95-906d-6d7d59a60653 admin admin] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.878600 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1343c-42bc-4d95-906d-6d7d59a60653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.878869 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1343c-42bc-4d95-906d-6d7d59a60653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.879529 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1343c-42bc-4d95-906d-6d7d59a60653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.881127 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1343c-42bc-4d95-906d-6d7d59a60653 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.891334 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1293/2592] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:37:36.895705 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79058327-b8c6-4764-a476-3d98b39a32ff admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:36.905819 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79058327-b8c6-4764-a476-3d98b39a32ff admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:36.910534 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0def8-d5fe-42e6-912f-46a71a760519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:36.911188 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0def8-d5fe-42e6-912f-46a71a760519 admin admin] REQUEST_METHOD: `PUT` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.911464 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0def8-d5fe-42e6-912f-46a71a760519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.911735 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0def8-d5fe-42e6-912f-46a71a760519 admin admin] PATH_INFO: `/v3/projects/a8f3fd2435b04c2096b30ee3ec866381/users/aab1726833d645408c3bd220ac912968/roles/30142fe6cc4944d988168c210fc8c902` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.927327 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0def8-d5fe-42e6-912f-46a71a760519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f3fd2435b04c2096b30ee3ec866381, user_id=aab1726833d645408c3bd220ac912968, role_id=30142fe6cc4944d988168c210fc8c902)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:36.930002 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0def8-d5fe-42e6-912f-46a71a760519 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:36.944726 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1300/2593] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:36 2022] PUT /identity/v3/projects/a8f3fd2435b04c2096b30ee3ec866381/users/aab1726833d645408c3bd220ac912968/roles/30142fe6cc4944d988168c210fc8c902 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:36.954959 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af145033-e4ea-42d7-97b4-4ffdb05ff1f7 None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:36.955313 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af145033-e4ea-42d7-97b4-4ffdb05ff1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:36.955690 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af145033-e4ea-42d7-97b4-4ffdb05ff1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:36.983992 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-af145033-e4ea-42d7-97b4-4ffdb05ff1f7 None None] MFA Rules not processed for user `aab1726833d645408c3bd220ac912968`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:36.985229 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-af145033-e4ea-42d7-97b4-4ffdb05ff1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:37.048617 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1294/2594] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:37.053085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0def8-d5fe-42e6-912f-46a71a760519 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:37.113041 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0def8-d5fe-42e6-912f-46a71a760519 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:37.117695 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782de3b-7bb9-416e-af51-54525e1fa8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:37.118281 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782de3b-7bb9-416e-af51-54525e1fa8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:37.118556 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782de3b-7bb9-416e-af51-54525e1fa8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:37.118822 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782de3b-7bb9-416e-af51-54525e1fa8c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:37.119430 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782de3b-7bb9-416e-af51-54525e1fa8c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:37.122002 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782de3b-7bb9-416e-af51-54525e1fa8c9 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:37.148087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1301/2595] 10.222.0.13 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:37 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:37.152247 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af145033-e4ea-42d7-97b4-4ffdb05ff1f7 None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:37.162825 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af145033-e4ea-42d7-97b4-4ffdb05ff1f7 None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:37.221616 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b9985-690f-4287-96e3-e552d1b26e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:37.222212 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b9985-690f-4287-96e3-e552d1b26e9c admin admin] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:37.222490 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b9985-690f-4287-96e3-e552d1b26e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:37.222999 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b9985-690f-4287-96e3-e552d1b26e9c admin admin] PATH_INFO: `/v3/users` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:37.223618 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b9985-690f-4287-96e3-e552d1b26e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:37.225526 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b9985-690f-4287-96e3-e552d1b26e9c admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:37.246260 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1295/2596] 10.222.0.13 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:37 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:37.250365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782de3b-7bb9-416e-af51-54525e1fa8c9 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:37.260377 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782de3b-7bb9-416e-af51-54525e1fa8c9 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:37.265275 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ab2ba-abb5-4075-84f9-5724ff625b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:37.265856 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ab2ba-abb5-4075-84f9-5724ff625b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:37.266128 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ab2ba-abb5-4075-84f9-5724ff625b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:37.266393 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ab2ba-abb5-4075-84f9-5724ff625b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:37.267091 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ab2ba-abb5-4075-84f9-5724ff625b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:37.268655 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ab2ba-abb5-4075-84f9-5724ff625b94 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:37.279369 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1302/2597] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:37.283503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b9985-690f-4287-96e3-e552d1b26e9c admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:37.294276 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b9985-690f-4287-96e3-e552d1b26e9c admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:37.298870 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585551e7-cd33-40cd-8fb4-026d17f77749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:37.299520 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585551e7-cd33-40cd-8fb4-026d17f77749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:37.299794 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585551e7-cd33-40cd-8fb4-026d17f77749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:37.300062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585551e7-cd33-40cd-8fb4-026d17f77749 admin admin] PATH_INFO: `/v3/projects/06d004bbc24f434487f9eaea3067815e/users/7dd3b2ad52134cb1896193d3ac627282/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:37.303017 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:37.316331 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585551e7-cd33-40cd-8fb4-026d17f77749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d004bbc24f434487f9eaea3067815e, user_id=7dd3b2ad52134cb1896193d3ac627282, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:37.319110 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585551e7-cd33-40cd-8fb4-026d17f77749 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:37.331775 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1296/2598] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:37 2022] PUT /identity/v3/projects/06d004bbc24f434487f9eaea3067815e/users/7dd3b2ad52134cb1896193d3ac627282/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:37:37.335621 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ab2ba-abb5-4075-84f9-5724ff625b94 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:37.341355 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:37.348014 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ab2ba-abb5-4075-84f9-5724ff625b94 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:37.405485 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288f7c3-beec-439e-af26-510f0cecb01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:37.406017 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288f7c3-beec-439e-af26-510f0cecb01f admin admin] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:37.406295 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288f7c3-beec-439e-af26-510f0cecb01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:37.406565 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288f7c3-beec-439e-af26-510f0cecb01f admin admin] PATH_INFO: `/v3/roles` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:37.407193 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288f7c3-beec-439e-af26-510f0cecb01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:37.408790 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288f7c3-beec-439e-af26-510f0cecb01f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:37.419763 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1303/2599] 10.222.0.13 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:37.423889 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585551e7-cd33-40cd-8fb4-026d17f77749 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:37.434181 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585551e7-cd33-40cd-8fb4-026d17f77749 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:37.439130 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc223a33-e266-464e-8244-593d65ee19ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:37.439808 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc223a33-e266-464e-8244-593d65ee19ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:37.440087 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc223a33-e266-464e-8244-593d65ee19ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:37.440363 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc223a33-e266-464e-8244-593d65ee19ca admin admin] PATH_INFO: `/v3/projects/06d004bbc24f434487f9eaea3067815e/users/7dd3b2ad52134cb1896193d3ac627282/roles/6a01757540e64fed9041997458bd64e5` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:37.442306 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc223a33-e266-464e-8244-593d65ee19ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d004bbc24f434487f9eaea3067815e, user_id=7dd3b2ad52134cb1896193d3ac627282, role_id=6a01757540e64fed9041997458bd64e5)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:37.444948 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc223a33-e266-464e-8244-593d65ee19ca admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:37.455728 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1297/2600] 10.222.0.13 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:37 2022] PUT /identity/v3/projects/06d004bbc24f434487f9eaea3067815e/users/7dd3b2ad52134cb1896193d3ac627282/roles/6a01757540e64fed9041997458bd64e5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:37.467649 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623f6a2-8821-443b-affe-a2f53240d907 None None] REQUEST_METHOD: `POST` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:37.467914 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623f6a2-8821-443b-affe-a2f53240d907 None None] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:37.468186 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623f6a2-8821-443b-affe-a2f53240d907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:37.496669 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.auth.core [None req-9623f6a2-8821-443b-affe-a2f53240d907 None None] MFA Rules not processed for user `7dd3b2ad52134cb1896193d3ac627282`. Rule list: `[]` (Enabled: `True`). {{(pid=81558) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:37.498093 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9623f6a2-8821-443b-affe-a2f53240d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:37.565648 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1304/2601] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:37:37.577518 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc223a33-e266-464e-8244-593d65ee19ca admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:37.579233 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-bc223a33-e266-464e-8244-593d65ee19ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:37.637503 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc223a33-e266-464e-8244-593d65ee19ca admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:37.641168 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229df26-0227-4992-80bf-d0933063d083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:37.641792 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229df26-0227-4992-80bf-d0933063d083 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:37.642062 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229df26-0227-4992-80bf-d0933063d083 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:37.642325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229df26-0227-4992-80bf-d0933063d083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:37.699718 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229df26-0227-4992-80bf-d0933063d083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:37.701123 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229df26-0227-4992-80bf-d0933063d083 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:37.710022 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1298/2602] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:39.207555 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623f6a2-8821-443b-affe-a2f53240d907 None None] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:39.209033 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-9623f6a2-8821-443b-affe-a2f53240d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:39.221549 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623f6a2-8821-443b-affe-a2f53240d907 None None] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:39.225401 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bb67a-f418-46e9-9b5b-4398ca3c135f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:39.225997 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bb67a-f418-46e9-9b5b-4398ca3c135f service cinder] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:39.226275 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bb67a-f418-46e9-9b5b-4398ca3c135f service cinder] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:39.226547 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bb67a-f418-46e9-9b5b-4398ca3c135f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:39.284055 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bb67a-f418-46e9-9b5b-4398ca3c135f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:39.285522 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bb67a-f418-46e9-9b5b-4398ca3c135f service cinder] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:39.294843 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1305/2603] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:39.815626 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229df26-0227-4992-80bf-d0933063d083 service cinder] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:39.825248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229df26-0227-4992-80bf-d0933063d083 service cinder] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:39.828854 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d188cc-5ff8-4062-b73a-7538c5ed0ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2972059254094f8e909eb2adbb0b2257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:39.829486 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d188cc-5ff8-4062-b73a-7538c5ed0ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:39.829761 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d188cc-5ff8-4062-b73a-7538c5ed0ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:39.830028 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d188cc-5ff8-4062-b73a-7538c5ed0ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:39.838774 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d188cc-5ff8-4062-b73a-7538c5ed0ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:39.840946 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d188cc-5ff8-4062-b73a-7538c5ed0ac0 service cinder] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:39.850531 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1299/2604] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:43.709221 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bb67a-f418-46e9-9b5b-4398ca3c135f service cinder] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:43.734272 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=100 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:43.770731 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bb67a-f418-46e9-9b5b-4398ca3c135f service cinder] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:43.775242 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:43.775847 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:43.776117 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:43.776382 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] PATH_INFO: `/v3/users/5f8171d9af4f47b69ce5f94090b6201a` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:43.777496 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8171d9af4f47b69ce5f94090b6201a)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:43.780085 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:43.826710 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8171d9af4f47b69ce5f94090b6201a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:43.833301 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8171d9af4f47b69ce5f94090b6201a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:43.833949 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8171d9af4f47b69ce5f94090b6201a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:43.845771 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8171d9af4f47b69ce5f94090b6201a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:43.852778 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8171d9af4f47b69ce5f94090b6201a'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:43.858585 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1306/2605] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:43 2022] DELETE /identity/v3/users/5f8171d9af4f47b69ce5f94090b6201a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:43.863225 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab6409-7c65-48da-b8f4-726c9749535c None None] REQUEST_METHOD: `POST` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:43.863729 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab6409-7c65-48da-b8f4-726c9749535c None None] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:43.863828 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab6409-7c65-48da-b8f4-726c9749535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:43.883049 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.auth.core [None req-b2ab6409-7c65-48da-b8f4-726c9749535c None None] MFA Rules not processed for user `0b9b00efe9544adbaaf4dd7abbf7b385`. Rule list: `[]` (Enabled: `True`). {{(pid=81559) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:43.884254 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b2ab6409-7c65-48da-b8f4-726c9749535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:43.942248 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1300/2606] 10.222.0.13 () {58 vars in 958 bytes} [Wed Nov 2 07:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:43.952447 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:43.953915 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:44.010364 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c70144-3363-4de2-9978-37b288a0b089 admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:44.014918 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aeeeef-5d36-4e34-ade5-f1267ac2ef69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f1a24bf15594b12bbf59741fcb46cf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:44.015506 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeeeef-5d36-4e34-ade5-f1267ac2ef69 service neutron] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:44.015786 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeeeef-5d36-4e34-ade5-f1267ac2ef69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:44.016054 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeeeef-5d36-4e34-ade5-f1267ac2ef69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:44.024981 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aeeeef-5d36-4e34-ade5-f1267ac2ef69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:44.026423 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aeeeef-5d36-4e34-ade5-f1267ac2ef69 service neutron] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:44.035706 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1307/2607] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:37:44.296615 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab6409-7c65-48da-b8f4-726c9749535c None None] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:44.298072 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-b2ab6409-7c65-48da-b8f4-726c9749535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:44.309909 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab6409-7c65-48da-b8f4-726c9749535c None None] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:44.314498 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:44.315120 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:44.315426 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:44.315706 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] PATH_INFO: `/v3/projects/d9bb3f77c9414098a3b210edc433db32` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:44.316797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9bb3f77c9414098a3b210edc433db32)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:44.318713 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:44.327559 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:44.364963 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9bb3f77c9414098a3b210edc433db32', 'request_id': 'req-ab5307bd-4874-4f30-97b5-f6a071d54d6f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.370393 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9bb3f77c9414098a3b210edc433db32', 'request_id': 'req-ab5307bd-4874-4f30-97b5-f6a071d54d6f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.376350 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9bb3f77c9414098a3b210edc433db32', 'request_id': 'req-ab5307bd-4874-4f30-97b5-f6a071d54d6f'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.389494 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] The token cache is being invalidate because project d9bb3f77c9414098a3b210edc433db32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:44.389789 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.390431 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.391914 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1301/2608] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:44 2022] DELETE /identity/v3/projects/d9bb3f77c9414098a3b210edc433db32 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:44.395901 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aeeeef-5d36-4e34-ade5-f1267ac2ef69 service neutron] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:44.406388 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aeeeef-5d36-4e34-ade5-f1267ac2ef69 service neutron] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:44.446554 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:44.463138 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:44.463758 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:44.464036 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:44.464306 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] PATH_INFO: `/v3/users/aab1726833d645408c3bd220ac912968` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:44.466070 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab1726833d645408c3bd220ac912968)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:44.468005 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:44.514602 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab1726833d645408c3bd220ac912968'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.522211 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab1726833d645408c3bd220ac912968'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.522848 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab1726833d645408c3bd220ac912968'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.534873 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab1726833d645408c3bd220ac912968'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.541683 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab1726833d645408c3bd220ac912968'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.548282 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1308/2609] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:44 2022] DELETE /identity/v3/users/aab1726833d645408c3bd220ac912968 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:44.822554 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:44.824165 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:44.841293 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5307bd-4874-4f30-97b5-f6a071d54d6f admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:44.896151 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:44.896821 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:44.897076 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:44.897351 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] PATH_INFO: `/v3/projects/a8f3fd2435b04c2096b30ee3ec866381` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:44.898450 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f3fd2435b04c2096b30ee3ec866381)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:44.900367 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:44.946723 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f3fd2435b04c2096b30ee3ec866381', 'request_id': 'req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.953066 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f3fd2435b04c2096b30ee3ec866381', 'request_id': 'req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.958903 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f3fd2435b04c2096b30ee3ec866381', 'request_id': 'req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.971325 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] The token cache is being invalidate because project a8f3fd2435b04c2096b30ee3ec866381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:44.971611 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.972231 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:44.973970 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1302/2610] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:44 2022] DELETE /identity/v3/projects/a8f3fd2435b04c2096b30ee3ec866381 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:44.977979 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:44.979357 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:44.991980 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c22cb1-bdd3-41f1-87a3-044aa61c515b admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:45.048490 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:45.049140 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:45.049419 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:45.049687 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] PATH_INFO: `/v3/users/7dd3b2ad52134cb1896193d3ac627282` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:45.050791 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd3b2ad52134cb1896193d3ac627282)` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:45.052684 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:45.099897 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd3b2ad52134cb1896193d3ac627282'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:45.106944 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd3b2ad52134cb1896193d3ac627282'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:45.107690 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd3b2ad52134cb1896193d3ac627282'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:45.115790 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:45.120840 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd3b2ad52134cb1896193d3ac627282'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:45.129087 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.notifications [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd3b2ad52134cb1896193d3ac627282'} {{(pid=81558) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:45.134926 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1309/2611] 10.222.0.13 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:44 2022] DELETE /identity/v3/users/7dd3b2ad52134cb1896193d3ac627282 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:45.401586 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] Authenticating user token {{(pid=81559) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:45.404797 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.fernet_utils [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81559) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:45.418163 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d7ca0-09b6-4e22-bec6-ef20e6781b20 admin admin] Validating token access rules against request {{(pid=81559) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:45.444550 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:45.478287 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9b00efe9544adbaaf4dd7abbf7b385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e777bb62ed84954afdd571094319647', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81559) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:45.478918 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:45.479246 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:45.479462 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] PATH_INFO: `/v3/projects/06d004bbc24f434487f9eaea3067815e` {{(pid=81559) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:45.480589 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d004bbc24f434487f9eaea3067815e)` {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:45.482644 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] RBAC: Authorization granted {{(pid=81559) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:45.527954 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d004bbc24f434487f9eaea3067815e', 'request_id': 'req-fb8f2938-ffb2-4433-88d9-9823391e1ba2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:45.533442 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d004bbc24f434487f9eaea3067815e', 'request_id': 'req-fb8f2938-ffb2-4433-88d9-9823391e1ba2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:45.540973 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d004bbc24f434487f9eaea3067815e', 'request_id': 'req-fb8f2938-ffb2-4433-88d9-9823391e1ba2'} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:45.555061 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] The token cache is being invalidate because project 06d004bbc24f434487f9eaea3067815e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81559) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:45.555351 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:45.555988 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG keystone.notifications [None req-fb8f2938-ffb2-4433-88d9-9823391e1ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81559) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:45.557472 dv-cinder-804035-51-smb devstack@keystone.service[81559]: [pid: 81559|app: 0|req: 1303/2612] 10.222.0.13 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:45 2022] DELETE /identity/v3/projects/06d004bbc24f434487f9eaea3067815e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:55.131417 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=7,keystone:DELETE=1 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:55.550351 dv-cinder-804035-51-smb devstack@keystone.service[81559]: DEBUG dbcounter [-] [81559] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81559) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:40:06.463399 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] Authenticating user token {{(pid=81558) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:40:06.464800 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:40:06.534365 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74008b-f75b-4f5c-832c-e962cf161d7f admin admin] Validating token access rules against request {{(pid=81558) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:40:06.592966 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54ee9a-4cbd-4858-ab59-870487f54b78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55214b594a3f42ff8a7e0cecdef98937', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8fa018afb294bfc82c59a82497ed9c3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81558) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:40:06.593601 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ee9a-4cbd-4858-ab59-870487f54b78 service placement] REQUEST_METHOD: `GET` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:40:06.593875 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ee9a-4cbd-4858-ab59-870487f54b78 service placement] SCRIPT_NAME: `/identity` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:40:06.594141 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ee9a-4cbd-4858-ab59-870487f54b78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81558) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:40:06.595820 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.fernet_utils [None req-6f54ee9a-4cbd-4858-ab59-870487f54b78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81558) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:40:06.607038 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54ee9a-4cbd-4858-ab59-870487f54b78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:40:06.608589 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54ee9a-4cbd-4858-ab59-870487f54b78 service placement] RBAC: Authorization granted {{(pid=81558) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:40:06.618271 dv-cinder-804035-51-smb devstack@keystone.service[81558]: [pid: 81558|app: 0|req: 1310/2613] 10.222.0.13 () {60 vars in 1365 bytes} [Wed Nov 2 07:40:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:40:16.614146 dv-cinder-804035-51-smb devstack@keystone.service[81558]: DEBUG dbcounter [-] [81558] Writing DB stats keystone:SELECT=58 {{(pid=81558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}